ON LOCAL GEOMETRY OF RANK 3 DISTRIBUTIONS WITH 
6-DIMENSIONAL SQUARE 

BORIS DOUBROV AND IGOR ZELENKO 

Abstract. We solve the equivalence problem for rank 3 completely nonholonomic vector dis- 
tributions with 6-dimensional square on a smooth manifold of arbitrary dimension n under very 
mild genericity conditions. The main idea is to consider the projectivization of the annihilator D 
QQ of a given 3-dimensional distribution D. It is naturally foliated by characteristic curves, which 

C^ are also called the abnormal extremals of the distribution D. The dynamics of vertical fibers 

f^ along characteristic curves defines certain curves of flags of isotropic and coisotropic subspaces in 

04 a linear symplectic space. The problem of equivalence of distributions can be essentially reduced 

,—1 to the differential geometry of such curves. 

^ ? The class of all 3-distributions under consideration is split into a finite number of subclasses 

' according to the Young diagram of their flags. The local geometry of distributions can be recovered 

^~H from the properties of the symmetry group of so-called flat curves of flags associated with this 

vN Young diagram. In each subclass we describe the fiat distribution and construct a canonical frame 

^_^ for any other distribution. 

F-K It turns out that for n > 6 in the most nontrivial case the symmetry algebra of the flat 

^^ distribution can be described in terms of rational normal curves (their secants and tangential 

^^ developables) in projective spaces and its dimension grows exponentially with respect to n. 

, ^, 1. Introduction 

,__( This paper is a next step of the long-standing program of studying the geometry of non- 

^ holonomic vector distributions using the ideas of geometric control theory. In earlier articles j3l S] 

r^ we have solved the equivalence problem for rank 2 vector distributions constructing a canonical 

*vj frame under very mild genericity conditions. 

ff^ In this article we treat rank 3 vector distributions on smooth manifolds of arbitrary dimen- 

r^ sion and solve the equivalence problem constructing a canonical frame for each three-dimensional 

^^ distribution D satisfying certain non-degeneracy conditions. The first such condition is the as- 

QP sumption that the dimension of the derived distribution D^ = D + [D, D] is 6. In the following 

. . we shall refer to such distributions as (3, 6, . . . )-distributions indicating that the dimensions of D 

_ ^ itself and D^ are 3 and 6 respectively. 

S^ The case of (3, 6)-distributions on 6 dimensional manifolds was considered by Robert Bryant [1] 

J-j using the Cartan equivalence method. In particular, Bryant proves that there is a natural para- 

bolic geometry of type B^ associated to each such distribution. The aim of the current article is 
to construct similar geometries associated with a given (3, 6, . . . )-distribution in any dimension. 
As in the case of rank 2 vector distributions the structure groups we get in dimensions 7 and 
higher are no longer semisimple. 

The obvious (but very rough in the most cases) discrete invariant of a distribution D at q a, 
so-called small growth vectors at q. It is the tuple {dim D^{q)}ji^^, where D^ is the j-th power 
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of the distribution D, i.e., D^ = D^~^ + [D,D^^^], D^ = D. More generally, at each point 
g G M we can consider the graded space m^ = X^j>i -D'^^^/D*. It can be naturally equipped 
with a structure of a graded nilpotent Lie algebra and is called a symbol of the distribution D 
at a point q. The notion of this symbol is extensively used in works of N. Tanaka and his school 
(see |l^) who systematized and generalized the Cartan equivalence method. However, these tools 
become really effective only when the symbol algebras are isomorphic at different points, and all 
constructions strongly depend on the algebraic structure of the symbol. Note that the problem of 
classification of all symbols (graded nilpotent Lie algebras) is quite nontrivial already in dimension 
7 (see [S]) and it looks completely hopeless for arbitrary dimensions. For example, as was shown 
in [8] already in dimension 7 the continuous parameters appears in symbols of rank (3,6,. . . )- 
distributions (see models 7n7_3_3(a) and ?n,7_3_13(a) there), and there are 6 more non-isomorphic 
symbols in addition to that. 

The core idea of our approach comes from geometric control theory and is based on construction 
of a characteristic line bundle associated with a given (3, 6, . . . )-distribution and the study of 
curves of flags of (co)isotropic subspaces obtained by its linearization. Our classification of rank 

3 distributions is done according to a so-called Young diagram of these curves of flags and is not 
directly related to Tanaka symbols of the distribution D itself. The local geometry of distributions 
can be recovered from the properties of symmetry groups of so-called flat curves of flags associated 
with a given Young diagram. 

Below we outline the main constructions and the results of the paper. They are given without 
proofs and repeated in more detail and with proofs in the main part of the paper. 

1.1. Characteristic 1-foliation of abnormal extremals. First we distinguish a characteristic 
1-foliation (the foliation of abnormal extremals) on a special odd-dimensional submanifold of 
the cotangent bundle associated with any rank 3 distribution D. Define the j'-th power of the 
distribution D as D^ = D and D^~^^ = D^ -\- [D,D^]. We assume that all D^ are subbundles of 
the tangent bundle. Denote by {D^) C T* M the annihilator of the j'-th power D^ , namely 

(D-^y = {(p, q) G r;M I p • u = Vv G D^q)}. 

Let vr : T*M i-^ M be the canonical projection. For any A G T*M, A = (p, g), g G M, p G T*M, let 
^C'^)!') = Pi"^*') be the canonical Liouville form and a = dc^ he the standard symplectic structure 
on T*M. 

The crucial notion in this paper is an abnormal extremal of a distribution. An unparametrized 
curve in D is called abnormal extremal of a distribution D if the tangent line to it at almost every 
point belongs to the kernel of the restriction ct\d± of a to D at this point. The term "abnormal 
extremals" comes from Optimal Control Theory: abnormal extremals of D are exactly Pontryagin 
extremals with zero Lagrange multiplier near the functional for any variational problem with 
constrains, given by the distribution D. 

Since diuiD = 3, the submanifold D has odd codimension in T*M, and the kernels of the 
restriction o"|£)± are non-trivial. Moreover, as we show below (Lemmallj), for points in D \{D'^) 
these kernels are one-dimensional. They form a characteristic line distribution in D \{D'^) \ 
which will be denoted by C. The line distribution C defines in turn a characteristic 1-foliation on 
D-^\{D'^)-^ . The leaves of this foliation are exactly the abnormal extremals of the distribution D 
lying in the complement to (D^) . 

It is more natural to work on the projectivization of the contangent bundle instead of the 
tangent bundle itself. We define the same objects on the projectivization of D-^\{D'^)-^. As 
homotheties of the fibers of D preserve the characteristic line distribution, the projectivization 
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induces the characteristic line distribution on FD \F{D'^) , which wih be denoted by C. It defines 
the characteristic 1-foliation, and its leaves are called the abnormal extremals of the distribution 
D on FD^\F{D^)^. 

The distribution C can be defined equivalently in the following way. Take the corank 1 dis- 
tribution on D \{D'^) , given by the Pfaffian equation ?|£)± = and push it forward it under 
projectivization to FD . In this way we obtain a corank 1 distribution on FD , which will be 
denoted by A. The distribution A defines a quasi-contact structure on the even dimensional 
manifold FD-^\F{D'^)-^ and C is exactly the characteristic distribution of this quasi-contact struc- 
ture. Moreover, the symplectic form a induces the antisymmetric form on each subspace of a 
distribution A, defined up to a multiplication by a constant. This antisymmetric form will be 
denoted by a. 

1.2. Lifting of the distribution to the cotangent bundle. We can consider the characteristic 
distribution C as a dynamical system naturally associated with any (3, 6, . . . )-distribution and 
study the dynamics of fibers of the natural projection vr: FD-^\F{D^)-^ -^ M. 

In more detail, let F be a vertical distribution defined as a set of tangent spaces to the fibers 
of the projection vr. Then, clearly, V is complimentary to C, and we arrive at a so-called pseudo- 
product structure^ which consists of a pair of 2 completely integrable distributions (C,y), whose 
sum is non-integrable. Indeed, the direct computation shows that the pull-back 7r*-D of D itself is 
easily recovered from C and V . Namely, we have 7r*D = F -|- C -|- [C, y]. In particular, this proves 
that the distribution C ®V \s bracket-generating. 

In this paper we require a stronger non-degeneracy condition on the distribution D. We con- 
struct a sequence of distributions starting from J^^"^' = C (BV hy taking the brackets only with 
the sections of characteristic bundle: 

j(-i) =c®v- 

j(^+^)=j(i) + [C,j(')], i>0. 

As J^^^' lies in the restriction of the quasi-contact bundle A to PD-'-\P(L'^)-'- and C is the 
characteristic bundle of this restriction, it is clear that all distributions ^7'*^ will be subbundles of 
the contact bundle. We say that the distribution D is of maximal class if J^"^"-' = A for sufficiently 
large m. 

In this paper we consider only (3, 6, . . . )-distributions of maximal class. We note that we are 
not aware of any examples of (3, 6, . . . )-distributions that are not of maximal class. 

We can prolong the sequence of subbundles J^^' to the negative side defining: 

It appears that the subspace J^~'^~^i is exactly the skew-orthogonal complement to J^^' with 
respect to the form a for any i > 0. In other words, we have: 

^M-i) = {X G A I a(X, J«) = 0}. 

Thus, we immediately see that the sequence J^~'^' descends to the characteristic bundle C for 
sufficiently small i. In addition, using the fact that dimjT'^*'-' — ^ya\J^~^' = 2, we prove that 
dim J'W - dim J^'-'^'i < 2 for any i G Z. 

Thus, at any generic point A G FD \F{D'^) we have a flag of subbundles: 

C C = j(-™-i) c j'^-"'^ C • • • C J^-'^^ =C + VC j(°) = Tr*D C j'^^^ C • • • C J^™) = A, 
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where the dimension gap between two neighbors in this sequence is either 2 or 1. 

1.3. Linearization of the flag along characteristic fohation. We linearize this sequence 
along the characteristic foliation and turn it into the curve in an appropriate flag manifold of a 
symplectic space at each point Aq € FD \F{D'^) . 

Namely, let 7 be a leaf of the characteristic 1-foliation C containing Aq and let A^ be a manifold 
of all leaves of C in a small neighborhood of Aq. Then 7 represents a point of N, and we have 
a natural projection $: FD \F{D'^) — > N defined in a neighborhood of Aq- Let A C T^N be 
the image of A under this projection. As it is a quotient of a codimension 1 distribution by its 
characteristic, it inherits a symplectic structure a defined up to a multiplication by a non-zero 
scalar. 

The differential <I>* takes Cx to and the flag of spaces {J^*-*^} at a point A to a certain flag of 
subspaces in A: 



A 



jo = j(-"^-i) c J(-™) C • • • C J(""~^) C J("") = a} , A G 7, 



where j(*) = <^4J^'^) for all i G Z. 

Thus, we get a natural map from 7 to the variety of all flags in the symplectic space A. We call 
this curve the linearization of the flag {J'^^'} along the characteristic curve 7. As it is defined in 
a natural way, any invariants of this curve will be automatically the invariants of the distribution 
D itself. One of the main points here is that the local geometry of rank 3 distribution can be 
reconstructed from the geometry of such curves of flag. Hence the core part of the paper is devoted 
to the study of the geometry of these curves. 

1.4. Geometry of curves of flags of (co)isotropic subspaces. 

(a) Young diagrams. To any curve of flags {J''^'} above one can construct a Young diagram: 
the number of boxes in i-th. row of it is equal to dim J^*-* — dim j'*~^). As the negative part 
of the flag is a skew- symmetric complement to the non-negative part, this diagram completely 
determines the dimensions of all quotient spaces J*^*-*/"^ foi' ^^Y i G Z. 

By construction there are no more than 2 boxes in each column. So, the diagram has the form: 

k I 



D 



and is completely determined by a pair of integers {k, I). This diagram is said to be of type {k, I). 
It is easy to get that k and / have to satisfy the relation n = 2k + 1 + 2, where n is the dimension of 
the base manifold M. In particular, the parity of / and n should coincide. Besides, the assumption 
diniD^ = 6 implies that the number of columns with 2 boxes is not less than 2. The case I = 
corresponds to rectangular Young diagrams, while / > corresponds to non-rectangular Young 
diagrams. We say that a (3,6,... )-distributions of maximal class is of the type {k, I) if germs 
of linearization of the flag {JT"'*^} at generic points of FD \F{D'^) (along the corresponding 
characteristic curve) have type {k,l). 

(b) Flat curves associated ^vith Young diagrams. All curves of flags with given Young 
diagram can be treated uniformly as a deformation of the so-called flat curve having the biggest 
group of symmetries. To describe the flat curve let 1/ be a vector space of the same dimension as 
A(7) (equal to 2n — 6 = 4A; -|- Z — 2) endowed with a one-parametric family of symplectic forms 
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such that any form from this family is obtained from any other by a multiphcation on a nonzero 
constant. Assume also that V is endowed with a filtration 

(1.1) V = l/(''+'~i) D . . . D y(-'^-'+i) z) V^''''^'> = 

such that dimy'*) = dimj'*-*, V^^' are isotropic for i < and V^^^"^' is the skew symmetric 
complement of V^"^' for any i. Finally assume that V is endowed with a distinguished basis 
(ei, . . .,e2k+i-i, /i, • • • , f2k+i-i) such that 

(1) this basis is symplectic w.r.t. to one of the form a from the one-parametric family of 

symplectic forms on V, i.e. a{ei,ej) = (T{fi, fj) = 0, for any i,j, a{ei, f2k+i-'i) = (-l)N 

and a{ei, fj) = for any i,j such that i + j ^ 2k + I; 



(2) the filtration (1.1) coincides with 

(1.2) C (ei) C (ei, eg) C • • • C (ei, . . . , e;) 

C (ei,...,ei+i,/i) C (ei,...,ez+2,/i,/2) C ••• C {ei, . . . ,e2k+i-i, fi ■ ■ ■ , f2k-i) 

C (ei, . . . , e2k+i-i, /i, • • • , /2fc) C • • • C (ei, . . . , e2k+i-i,fi, ■ ■ ■ , f2k+i-i) = V- 
Now define a linear maps X G End(y) as follows: 



Xci = Cj+i, Xfi = /j+i ioT i = l,...2k + l-2, Xe2k+i-i = Xf2k+i-i = 0. 

S)xk+l-l 
SklSi=~k-l 



We say that the curve of flags ^k,i = {5^1 ;}j=-_t._; is aflat curve associated with the Young diagram 



of type {k,l), if it is an orbit of the flag (1.2) under the action of the one-parameter subgroup 
exp{tX). A symplectic moving frame (ei(-), . . . , e2k+i-i{-), fii'), ■ ■ ■ , f2k+i-ii')) is called normal 
moving frame of the flat curve ^k,l i if 

^fc z(') = (ei(-); • • • ei+k+i{-)), i = -k-l,...,-k 

^m(-) = (ei(-), • • • ei+k+i{-), /i(-), • • • , /^+fc(-)>, i = -k + l,...,k + l-l 

and for some parametrization t of the curve 

e^t) = e^+i{t),m = /i+i(t), ioTi = l,...2k + l-2, ~e'2k+i-i{t) = fL+i^iit) = 0. 

Note that the frame (exp(fX)ei, . . . ,exp(tX)e2A:+/-i,exp(tX)/i, . . . ,exp(tX)/2fe+i-i), where Cj 
and fi are as above, is a normal moving frame of the flat curve {5^'*'}jJr_^_;. 

Let 6k^i be the group of all isomorphisms A of V, sending the flat curve to itself and preserving 
the one-parametric family of symplectic forms on V. The latter means that for any form a from 
this family there exists a nonzero constant c such that 

(1.3) a { Avi, Av2) = ca {vi,V2), \/vi,V2eV. 

In other words, 6k,i is the group of symmetries of the flat curve. Denote 5k,i the corresponding 
Lie algebras (i.e. the Lie algebra of infinitesimal symmetries of the flat curve). 

(c) Bundles of moving frames and their symboL 

Let us clarify what do we mean by saying that any curve of flags with given Young diagram 
is a deformation of the corresponding flat curve. For any such curve we construct a bundle of 
canonical moving frames of dimension equal to the dimension of the group of symmetries &k,i of 
the flat curve. For the flat curve this bundle of canonical moving frames coincides with all its 
normal moving frames defined above. Take as before a manifold N of all leaves of the characteristic 
foliation C in a small neighborhood of a point Aq G FD \F{D'^) such that the linearizations of 
the flag {J^^^'} along any leaf of C in this neighborhood has the Young diagram of type {k,l). 
Take j £ N and collect all frames on A(7), obtained from all canonical moving frames for the 
linearization of of the flag {^T'*^} along 7. In this way we get the canonical frame bundle P 
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on the contact distribution A of the manifold N. By the frame bundle on a distribution of a 
manifold we mean a fiber bundle over this manifold with the fiber over a point consisting of 
some distinguished frames of the distribution at this point. The frame bundle we construct is 
not in general a principle fiber bundle, but it still possesses a number of nice properties such as 
a constant symbol. 

In more detail, we define a symbol of the frame bundle P on A as follows. Take the subspace 
V with the distinguished frame as in paragraph (b). Then any frame p on A can be identified 
with the isomorphism between V and A, sending the distinguished frame on V to the frame p. 
Hence, the tangent space to a fiber of P at a point p can be identified with a subspace of 0l(V'). 
The filtration on V induces a natural filtration on g[(T^) and, therefore, on any its subspace. The 
corresponding graded subspace gr TpP is called a symbol of the bundle P at a point p. Symbols 
are subspaces of gTQl(y), which, in turn, is naturally identified with Ql(giV). In the case of 
rectangular diagram already the tangent spaces to a fiber of P at different points are the same, 
as subspaces of qKV)- On the other hand, in the case of nonrect angular diagram this tangent 
spaces at different points are different subspaces of 0^(1^). However, all symbols at different 
points of this bundle are the same. Moreover, in both cases the symbol is equal to the algebra of 
infinitesimal symmetries S/^^i of the flat curve (under the natural identification of V and gr V via 
the distinguished basis on V). 

(d) Prolongation procedure. We emphasize that our frame bundles on the corank 1 dis- 
tribution A are not even principle bundles in general, but the additional filtration on the model 
space V for these bundles allows to define the notion of symbol of the bundle at a point. It turns 
out that assuming that the symbol is constant, it is possible to carry prolongation procedure for 
such frame bundles in a similar way as in the classical theory of G-structures on manifold and as 
in the Tanaka theory for G-structures on filtered manifolds [10]. Since originally we have frames 
not on the whole tangent bundle but on a corank 1 distribution only, we have to modify the notion 
of the Spencer operator and of the prolongation (of subspaces of 0[(T^) and of frame bundles). As 
in case of standard G-structures, if for some i > the modified i-th prolongation of the symbol 
5fc,« of our frame bundle P is trivial, then for any distribution of type {k, I) there exists a canonical 
frame on a certain bundle Q over A'^. This bundle is constructed as the i-th prolongation of the 
frame bundle P. 

The modified i-th prolongation s^*^ of the symbol 5k,i has a simple description in terms of 
the Tanaka prolongation of a certain graded Lie algebra. First let g_i = V and 0_2 = Mry for 
some vector rj. Define the structure of a graded Lie algebra on the vector space 0_2 © 0-i by 
setting [^1,^2] = cr{vi,V2)'r] for some form a from the one-parametric family of symplectic forms 
on V. This Lie algebra is isomorphic to the Heisenberg algebra. Now set 0o = Sfc,/. Note that 
by construction 5k,i is a subalgebra of the Lie algebra csp(y) corresponding to a Lie group of all 



isomorphisms AoiV satisfying ( 1.3 ). On the other hand, it is clear that C5p(y) coincides with the 
algebra of all derivations of 0-2 ©0-i preserving the filtration. Therefore the space 0_2 ©0-i ©0o 
can be endowed with the natural structure of a graded Lie algebra as well by setting [A, v] = Av 
for any A £ qq and v £ V. Let 

^k,i = 0i = M7? © y © Sk,i © 0i 

i>-2 i>l 

be the Tanaka universal prolongation ( [TO] ) of the graded Lie algebra 

(1.4) 0_2©0-i©0o = Mr?©T/©Sfc,«. 
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It turns out that our modified ith prolongation s^*^ coincides with the Tanaka ith prolongation 
Qi of the algebra g_2 ® 0-i © So for any i > 1. 

The Lie algebra ^k,i is finite dimensional for any (fc, /). We will describe it explicitly in the next 
subsection. Moreover, to any pair (fc, I) one can assign in a natural way a (3, 6, . . .)-distribution 
of maximal class and type (/c, I) such that its algebra of infinitesimal symmetries is equal to &k,i- 
For this let (3^^ be a subgroup of ©k,h preserving the filtration (1.1), i.e., one point of the flat 
curve, and s^ ^ be the corresponding Lie algebras. Consider the following subalgebra p^^; of '&k,i 



where V^ "^^ is as in the filtration (1.1). 



Let Gk,i be a Lie group with the Lie algebra g and let P^^i be a subgroup corresponding 
to the subalgebra p^^;. Then there is an invariant 3-dimensional distribution on Gk,i/Pk,l that 
corresponds to the Pfc^;-invariant subspace 



&r/©y(o)©5fcj©0gi 



i>l 



™0fe,«/pfc,i (note that dim Sfc^;— dim 5^ ^ = 1 and dim !/('')— dim y( ^' = 2). We call this distribution 
a flat (3, 6, . . . )- distributions of type (k,l). 

The flat (3, 6, . . . )-distribution of type {k, I) can be described in more explicit way as follows. 
Consider a Lie algebra rrifc^;, generated as a vector space by elements X, Yi{l < i < k), Zj{l < 
j < k + 1), rj, with the following non-trivial Lie brackets: 



[X,Y^ 


— Yi+i, 


i=l,.. 


.,k-l; 


[X,Z,] 


= Zj+i, 


J = l,- 


..,k + l 


[Yi,Zi] 


= T]. 







The flat (3, 6, . . . )-distributions of type {k, I) is equivalent to a left-invariant distribution on the 
Lie group Mk^i with the Lie algebra mk,i, which corresponds to the subspace Do = {X,Yi, Zi). 
The main result of the paper can be formulated as follows: 

Main Theorem. For any (3, 6, . . . ) -distribution D of maximal class and type {k, I) there exists 
a natural fiber bundle Q over the manifold N equipped with a canonical frame. The dimension of 
Q is equal to the dimension of the Lie algebra <dk.i- There exists (3,6, . . . )- distribution of maximal 
class and type {k, I) such that its algebra of infinitesimal symmetries is equal to (5k,l 

As a matter of fact if a (3, 6, . . . )-distribution D of maximal class and type (fc, /) has the algebra 
of infinitesimal symmetries of dimension equal to dim ©fc,Z) then D is locally equivalent to the flat 
(3, 6, . . . )-distribution of maximal class and type (fc, /). This uniqueness statement will be proved 
in the forthcoming paper. 

1.5. Description of algebras Sk^i and &k,h To complete the picture we describe explicitely the 
symbols of our frame bundles (isomorphic to algebra of infinitesimal symmetries 5k,i of the flat 
curve of of flags of type (A;, /)) and the corresponding universal prolongation algebra (5k,i from the 
main theorem. The cases of rectangular and non-rectangular diagrams are essentially different 
and considered separately 
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(a) The case of rectangular diagram. In this case / = 0. Let V2k-i = {Ei, . . . , E2k-i) be 
the irreducible {2k — l)-dimensional 5l(2,M)-module with weight spaces (Ei) and M^ = (£1,62) be 
the standard gl(2, M)-module. Identify the space V with the s[(2, M) ©g[(2, M) module ^2^-1 OM^, 
such that ei = Ei® si and fi = Ei® 82- Then the algebra Sfc,o is equal to the image in QliV) of 
the representation of the algebra s[(2, r) © 0l(2, r), corresponding to the module V2k-i ® '^■ 

Further, it turns out that ©2,0 = so(4, 3) (compare with |1]). On the other hand, for A: > 3, 



/ = the first prolongation 31 of the algebra (1.4) is equal to so that 



(1.5) (5fe,o = %©^©Sfc,o, ^>3. 

(b) The case of non-rectangular diagram. The structure of the Lie algebras s^ ; and 
0fc / in case / > is much more complicated and can be defined via the language of symplectic 
differential geometry. Let r = 2k-\-l — 1. Fix a (formal) coordinate system (xi, . . . ,Xr,pi, ■ ■ ■ ,Pr) 
in the symplectic space of dimension M^'' with the symplectic form: 

dxi A dpr — dxi A dpr^i + • • • + ( — 1)'"^ dxr A dpi. 

Introduce the Poisson Lie bracket on the algebra of polynomials M[xj,pj]. We shall define <dk.i as 
a one-dimensional extension of a certain subalgebra in this algebra. 

Let p**"! be the projective space with homogeneous coordinates [xi : X2 : ■ ■ ■ : Xr]- Denote by 
C the normal rational curve in f^^^ given as an image of the Veronese embedding 



There is a unique irreducible SL{2, i?)-action on W such that this rational normal curve is exactly 
an orbit of the highest vector in M*" under this action. 

Denote by T'^C the 6-th tangential developable variety of C. Here we assume that T^C = C. 
If V is any algebraic variety in P^~^, we denote, as usual, by /(V) the ideal of homogeneous 
polynomials in xi,...,Xr vanishing on V. We shall also denote by /^(V) the subspace of all 
polynomials of degree b in /(V). Denote also by S},V the 6-th secant variety of V, which is defined 
as an algebraic closure of the union of (n — l)-planes in p^~i passing through h points from V. 
By definition we set 5i(V) = V and Si{V) = for z < 0. 

Now define a subalgebra g in ]R[xj,pj] in ]R[xj,pj] as a sum of the following several subspaces 
in M.[xi,pj\: 

• the subalgebra 01(2, M) spanned by: 

X = {r - l)x2Pr - (r - 2)x3Pr-i H h {-lY~^XrP2] 

Y = XiPr-l - 2xiPr-2 H h (-l)''~^(r - l)Xr^lPl] 

H ={r - l)xipr - (r - 3)x2Pr-i H h (-1)''"^(1 - r)xrPi; 

Z = XiPr - X2Pr-l + ■■■ {-lY'^XrPl- 

• {pi,---,Pn); 
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• Is = /s(Vs) C M[xi, . . . ,Xr], where Vg = 5s_i(T'^^^C) is the {s — l)-th secant variety of 
{k — 2)-th tangential variety to the rational normal curve C. In particular, we have: 

h = {xi,...,Xr); 

I2 = quadratic polynomials vanishing at 7 C; 

/3 = cubic polynomials vanishing at S2{1 C); 

Note that in the extreme case of A; = 2 we have T C = C, and, for example, I2 is spanned 
by all quadratic polynomials of the form XiXj — XkXi, i + j = k + I. In general, for any k > 2 
the tangential variety T C does not lie in any proper linear subspace of P*""^. Therefore 
5s_i(T C) = P*""^ for sufficiently large s, and Is = 0. Thus, q is always finite-dimensional, 
though its dimension depends exponentially on r and therefore on the dimension of the original 
manifold M (for a fixed k >2). 

The algebra s^,; is equal to {X,Y, H, Z,ld) © l2- The algebra &k,i is isomorphic to a one- 
dimensional extension of the Lie algebra g by a semisimple element Z' such that 

[Z',/] = (deg(/)-2)/ 

for any element / G g C M[a;j,pj]. 

Finally note that the main result of [3^ and [T about rank 2 distributions on an n dimensional 
manifold can be formulated in a similar way as in our Main Theorem here. The Young diagram 
of the linearizations consists of one row, the corresponding flat curve is a curve of complete flags, 
consisting of all osculating subspaces of the rational normal curve in the projective space p^"-^^ 
the algebra of its infinitesimal symmetries is equal to the image of the irreducible embedding of 
g[(2, M) into Sn = g[(^), where dim V = 2n — 6, the flat distribution and its algebra of symmetries 
is described as in the subsection 1.4 (d), replacing 5k^i by Sn- In particular, the algebra of 
infinitesimal symmetries is equal to the Tanaka universal prolongation of Mr] (BV(BSn, which is 
equal to Mr] © ^ © s„ itself for n > 5 and to the exceptional simple Lie algebra G2 for n = 5. All 
this suggests that our Main Theorem can be generalized to much general situation of distributions 
of arbitrary rank. 

2. Symplectification procedure 

2.1. Description of a characteristic line distribution. Let us describe the characteristic line 
distribution C from subsection |1.1| in terms of a local basis {Xi,X2,X3) of the distribution D, 
D{q) = span{Xi{q),X2{q), X3{q)}. Denote Xij = [Xi,Xj] for 1 < i, j < 3. Let us introduce the 
"quasi-impulses" Ui : T*M ^ M, mj : T*M ^'m, 1 <i,j <3: 

(2.1) n,(A) = p ■ Xi{q), Uij{X) = p ■ Xij{q) X = {p,q), q G M, p G T*M. 
Then by definitions 

(2.2) D^ = {A G T*M : ui{X) = U2{X) = us{X) = 0}. 

As usual, for given function G : T*M ^^ M denote by G the corresponding Hamiltonian vector 
field defined by the relation i^a = —dG. 

Lemma 1. The characteristic line distribution C on D^\{D'^)-^ satisfies 

(2.3) C = {U2,3UI - ni,3M2 + ^1,2^3). 
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Proof. Take a vector field H on D^\{D^)^ such that locally C(A) = {Mi7(A)}. Then by definition 



of C we have ^h<5'|(£)2)± = 0. From this and (2.2) it follows that ino' G {dui,du2,dus), which 
implies that 

(2.4) H £{ui,U2,U3). 



On the other hand, H is tangent to D , i.e duj{H) = for 1 < j < 3. This and (2.4) easily 



implies (2.3). D 

Let D'{q) C D{q) be the union of one-dimensional subspaces 7r*(C(A)) is equal to D{q): 

(2.5) D'{q) = {7r,(C(A)) : A G D^\{D^)^ ,^{X) = q] . 

As a consequence of the previous if dim D^{q) = 6, then 

(2.6) D'{q) = D{q) 

In particular, in this case the original distribution can be recovered from its characteristic line 
distribution. 

Similarly, from (2.3) it follows that if dim D^{q) = 4 or dimL>^(g) = 5, then the set D'{q) 



constitutes a one-dimensional or a two-dimensional subspace of D{q) respectively. If dim D^{q) = 
4 then a line distribution D' is a characteristic subdistribution of D, i.e. [D',D] C D. In this 
case we can make, at least locally, a factorization of M by the 1— foliation generated by the line 
distribution D'{q) so that in the quotient manifold we get the rank 2 distribution D{q)/D'{q). 
In this way we reduce the equivalence problem for the original rank 3 distribution D to the 
equivalence problem for certain rank 2 distribution, which was treated in [3111] If dimZ)^(g) = 5, 
then it can be shown that the rank 2 subdistribution D' satisfies {D')"^ C D and this is the unique 
rank 2 subdistribution, satisfying this property. Therefore, sometimes it is called the square root 
of the distribution D. There are two possibilities: either {D')'^{q) = D{q) for generic g on M 
or D'{q) is involutive, i.e. (-D')^ = D' . In the first case the equivalence problem for rank 3 
distributions is reduced to the equivalence problem for rank 2 distributions, which was treated in 

mil]. 

So, the equivalence problem for rank 3 distributions cannot be reduced to one for rank 2 
distributions only in the following two cases: dimD^ = 6 or divnD^ = 5 and the square root 
D' is involutive. In the present paper we restrict ourselves to the case diml?^(g) = 6, i.e. to 
(3, 6, . . . )— distributions 

2.2. The curves of flags associated ^vith abnormal extremals. In what follows the canon- 
ical projection from PZ?-*- to M will be denoted also by vr. By analogy with [3] and jl], let ^ be 
the pull-back of the distribution D on ¥D-^\¥{D'^)-^ by the canonical projection vr: 

(2.1) J{\) = {ve Tx{FD^) : TT,v£ D{Tr{X))}. 



Note that dim^T" = n — 1, J' C A, and C C ^7 by (2.3) . The distribution J^ is called the lift of 
distribution D to FD-^XFiD"^)-^. 

In the sequel we shall work with the lift J' instead of the original distribution D. The crucial 
advantage of working with J' is that it has the distinguished line sub-distribution C, while the 
original distribution D has no distinguished sub-distributions in general. 

We can produce a monotonic (by inclusion) sequence of distributions (in general of nonconstant 
ranks) by making iterative Lie brackets of C and J'. Namely, first define a sequence of subspaces 
J'(*)(A), A G FD-^\F{D'^)-^, by the following recursive formulas: 

(2.2) J(°)=J, J^''^=J^'~^^ + [C,J^'-'^], Vi>l. 
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(.3) :..-..,., . ^, . :..-.„) .. L;r p:^w"/;-.w!' "" ^ " ^ ^^ ^ '■ 



It is easy to show that in (2.3) one can replace the quantor 3 by V. It is clear by constructions 
that J^'\X) C J^(*+i)(A) for ah i G Z^ Besides, J^') C A for any i G Z, because J CA and C is 
the characteristic subdistribution of A. Thus we get a flag 

(2.4) . . . C j(-*)(A) C . . . C j(-^\X) c j(°)(A) C j(i)(A) ^ . . . C J«(A) C . . . c A(A) 
Further, by analogy with [12 and [13], the following identity holds 

(2.5) J^-^-'\X) = {veA{X):a{v,w) = OyweJ^'\X)}, Vi > 0, 

where as before a is the antisymmetric form defined on each subspace of the distribution A 
canonically up to a multiplication by a constant. 

We summarize the main properties of the sequences {J^^'^iez in the following: 

Proposition 1. 

(1) dim J'(i)(A) - dim J'(A) < 2 and the equality holds iff dim. D'^{n{X)) = 6, 

(2) dim J^W(A) - dimJ^'-^\X) < 2, for any i e Z 

(3) [C,J^'-^^] C J« and[C,J^'-^^] = T if and only if either i > 1 or dim jW -dim J^'"^) = 
dim J^(*-i) - dim J^(*"2) j^^ ^ < q. 

Proof. Given a point A G FD \F{D'^) take a vector field H on M tangent to D such that 
7r^C{X) = {M-ff (7r(A))}. Then directly from definition it follows that 

j(i)(A) = {ve Tx{FD^) -.TT.ve [H,D]{Tr{X))}. 

This implies property (1) of the proposition. Property (2) for i > 2 follows from the first relation 
of Property (1) and the fact that the distribution C has rank 1. Property (2) for i < follows 



from relation (2.5). Property (3) follows easily from definitions (2.2) and (2.3). D 



The dynamics of the flags ( |2.4[ ) along any abnormal extremal defines certain curve of flags 
of isotropic and coisotropic subspaces in a linear symplectic space. More precisely, let 7 be a 
segment of abnormal extremal of D and Oj be a neighborhood of 7 in FD-^ such that the factor 
N = 0^/{the characteristic one-foliation) is a well defined smooth manifold. Let <I> : O^ -^ N 
be the canonical projection on the factor. For each i ^ "L we. can define the following curves of 
subspaces in T^A^: 

(2.6) A^ J«(A) =^$4J»(A)), 

def ~ 

Note also that A = <I>*A is well defined contact distribution on A^ and the form a induces 
on each space A (7) the canonical, up to a multiplication by a constant, symplectic form, which 
win be denoted by a. From ([2^ it follows that j(*)(A) C A(7) for alU G Z and A G 7. By 



constructions, 

(2.7) j(-^-^)(A) = {J^^{X)Y 

Moreover, the subspaces J^*^(A) are coisotropic w.r.t. the form a for i > and isotropic for i < 0. 
Besides, dim A(7) = 2(n — 3) and dim j('^)(A) = n — 2. 
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The curve 

(2.8) A ^ {. . . C j(-*)(A) C . . . C j(-i)(A) C J(A) C JW(A) ^ . . . C J«(A) C . . .| , A G 7, 

of flags of isotropic and coisotropic subspaces in a linear space A(7) will be called the linearization 
of the flag {J^^^'} along the characteristic curve 7. Clearly, any invariant of such curve w.r.t. the 
action of the group CSp(A(7)') of linear transformations of A(7), preserving the form a up to 
a multiplication by a constant, automatically produces an invariant of the distribution D itself. 
Moreover, it turns out that under certain generic assumptions one can construct the canonical 
frames of the distribution D from the study of bundles of moving frames canonically associated 
with such curves. 

The point A G FD-^\F{D'^)-^ is called regular if there is i(A) G N such that J*(^)(A) = A(7), 
where 7 is the abnormal extremal, containing A. The point A is called strongly regular, if it is 
regular and there is a neighborhood [/ of A in ¥D such that for any i G N dimensions of J'*^(A) 
does not depend on A G 7 n [/. Strong regularity implies that 

(2.9) dim j(*+i)(A) - dim jW(A) < dim j(*)(A) - dim J^'-^\X). 

and we define as follows the Young diagram T of the curve J^^' at A: for i > 1 the number of 
boxes in the ith. column of T is equal to dim j'*)(A) — dim J''*~^''(A). A strongly regular point A 
such that the Young diagram of the curve J^^' at A is equal to T will be also called T -regular. 
Rewriting Properties (l)-(2) of Proposition 111 in terms of subspaces J^^'{X), we get 



Proposition 2. 

(1) dim j(i)(A) - dim J(A) < 2 and the equality holds iff dim D^{tt{X)) = 6, 

(2) dim J(*)(A) - dim j(*-i)(A) < 2, for any i e Z 

The last proposition means that columns of the Young diagrams of linearizations along abnor- 
mal extremals of rank 3 distributions have either one or two boxes and the first column has two 
boxes if and only if dim D^(7r(A)) = 6. 

Definition 1. A rank 3 distribution D is said to be of maximal class at a point q G M , if there 
exists at least one strongly regular point A G PD \P(D^) such that 7r(A) = q. 

Since distributions J^ and C are algebraic on each fiber of FD-^, the maximality of class at a 
point q implies that there is a Young diagram T such that the set of T-regular points of the fiber 
7T~^{q) nFD-^ is a nonempty Zariski open subset. In this case T will be called the diagram of the 
distribution D at the point q. 

In the sequel we will study rank 3 distributions of maximal class with dim D^ = 6 and with the 
fixed diagram T, i.e. (3,6,...) distributions. The number of columns in the diagram T, consisting 
of one box, is called the shift of the diagram T and it will be denoted by /. We also assume that 
the number of remaining columns (all of which consisting of 2 boxes) is equal to k—1. In this case 
we also say that the diagram T is of type (/c, I). From the assumption that dim D^ = 6 it follows 
that k > 2. Note that the number of boxes in T is equal to rankA(7) — rank J^'^)(A) = n — 4. 
Therefore n = 2k + I + 2 and the parity of / is equal to the parity of n (recall that n is the 
dimension of the ambient manifold M) . 

Note that germs of rank 3 distributions of the maximal class are generic. Indeed, from alge- 
braicity of distributions J^ and C on each fiber of FD it follows that the distribution has maximal 
class at a point go if and only if its jet of sufficiently high order belongs to the Zariski open set of 
the jet space of this order. Therefore in order to prove the statement it is sufficient to give just one 
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example of a germ of rank 3-distributions of the maximal class. The flat (3, 6, . . . )-distribution of 
type {k, I) with 2k + I + 2 = n, define in the Introduction, provides such example. 

Finally let us reformulate property (3) of Proposition 111 in terms of subspaces J^*^(A). For 
this let us introduce some notation. Let Gk(W) be the Grassmannian Gk(W) of /c-dimensional 
subspaces of a linear space W. Take a smooth (unparametrized) curve A : 7 i-^ Gk(W). Let ©(A) 
be the set of all smooth curves £ : 7 1— > VF such that i{X) G A(A) for all A G 7. If 99 : 7 ^^ M is a 
parametrization of 7, (p{X) = and ip = ^~^, then denote 

(2.10) P»A(A) = span{^^(V(t))|t=o : i G ©(A), < j < i]. 
In particular, directly from definitions it follows that 

(2.11) J«(A)=P»J(A). 

Besides, as a consequence of property (3) of Proposition II] we have the following 

Propositions. Assume that Ms strongly regular, thenV^^'J^^~^'{X) C j(*)(A) andV^^>J^''^^\X) - 
J«(A) if and only if either i > 1 or dim J«(A) - dimJ^'~^\X) = dim j(*-i)(A) - dimJ^'~^\X) 
for i <0. 

3. Canonical bundles of moving frames for curves of flags associated with 

abnormal extremals 

In the present section given the Young diagram T of type {k, I) with k > 2 we construct the 



canonical bundle of moving frames for any curve of flags (2.8) with the diagram T in a linear 
space A(7). This gives automatically the canonical frame bundle for any rank 3 distribution 
with the diagram T on the contact distribution A of the manifold N constructed in the previous 
section. The main point is that this frame bundle has the constant symbol in a sense defined in 
the Introduction. This symbol is actually equal to the algebra of infinitesimal symmetries of the 
flat curve of flags, corresponding to the diagram T. 

We will work with j'*' considered as a vector bundle over 7 with the fiber J^^'{X) over a point 
A. The cases of rectangular and non-rectangular Young diagrams are quite different and will be 
considered separately. 

3.1. Curves of flags ■with rectangular diagram. Assume that the shift / of the diagram T is 
equal to zero, i.e. T is a rectangle with 2 rows and 2k — 1 columns. In this case J^~ '{X) = 
and dimj(-'=+i)(A) = 2. By Proposition g we have {J^-''+'^^)^'^^-'^\X) = A{-f). First fix a 
parametrization (^ : 7 h^ M of 7. In the sequel, if s is a section of the bundle j'*', then the vector 
s{t) belongs to J^'^'[ip~^{t)^. The bundle j(~'^+^) has a unique (w.r.t. the parametrization 99) 
connection such that any its horizontal section e satisfies 

(3.12) e'^^''-^\t) e f'^''-^\ip-Ht)) Vt. 
A tuple 

(3.13) (ei(t),e2(t),e;(t),e'2(t),...,ef-')(t),ef-')(t)), 

where ei and 62 are horizontal sections of the canonical (w.r.t ip) connection on the bundle 
j(-fc+i) is called the normal (w.r.t ip) moving frame of the curve (2.8) generated by the pair 



(ei, 62). All such frames (for the fixed parametrization (p ) constitute the principle bundle over 7 
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with a structure group GL(2,M). If ei and 62 are two nonproportional horizontal sections of the 
canonical connection on the bundle j'~ '*"^\ then 

(f:::;!)=I-(l:;:) 

for some 2 x 2-matrices Ai{t). Note that the operator Af{X) : J^ '^+^)(A) ^^ J^ '^^^^(A) , having 
the matrix Ai{t)) w.r.t. the basis (ei(t), e2(i)), where t = ip{X) does not depend on the choice of 
the sections ei and 62 as above. The operators Af{X) are invariants of the parameterized curve 



Now we will show that the curve (2.8) (or equivalently the curve 7) can be endowed with 
the canonical projective structure, i.e., we have a distinguished set of parameterizations (called 
projective) such that the transition function from one such parameterization to another is a 
Mobius transformation. For this let 

(3.15) pi,^(A)=tr(^^,„3(A)). 

How pi^ip transforms under reparametrization of 7? Let c^i be another parametrization and 
V = ip o ip^ . Then it is not hard to show that pi,<^ and pi,(^i are related as follows: 

(3.16) pi,^,(A) = v'{t)^Pi,^W + CIS{v){t), t = (^i(A) 

where S{v) is a Schwarzian derivative of v, i.e. S{v) = ^ ( ^^ J — ( ^^ J and C^ is a nonzero 
constant. From the last formula and the fact that St; = if and only if the function v is Mobius 
it follows that the set of all parameterizations (p of j such that 

(3.17) pi,^ ^ 

defines the canonical projective structure on 7. Such parameterizations are called the projective 
parameterizations of the abnormal extremal 7. The set of the normal moving frames of the curve 



(2.8) w.r.t. all projective parameterizations constitute the principle bundle over 7 with a structure 
group ST(2, M) x GL(2, M), where ST(2, M) denotes the group of lower triangular real 2x2 matrices 
with unit determinant. 

Now let, as before, A^ be a manifold of all leaves of the characteristic foliation C in a small 
neighborhood of a point Aq S FD \F{D'^) such that the linearizations of the flag {JT"^*^} along 
any leaf of C in this neighborhood has the Young diagram T of type (fc, 0). Consider the fiber 
bundle Pfc,o over A^ such that its fiber over a point 7 is the set of tuples (7, ip, (ei, 62)), where ip 
is a projective parametrization on the leaf (the abnormal extremal) 7 and (61,62) is a basis of 
j(-*:+i)((^-i(0)). By construction, P^q is a principle bundle with a structure group SL(2,M) x 
GL(2,M). 

To any point F G Pk,o, T = (7, p, (ei, 62)), assign the frame 5^i(F) on the space A(7) which is 



equal to the value at of normal w.r.t ip moving frame of the curve (2.8 1 generated by the pair of 
horizontal sections equal to (61,62) at 0. Actually, ^i maps the fiber of Pkfl over 7 to the space 
of all frames on A(7). It is easy to see that this mapping is an injective immersion. So, the fiber 
of Pkfi over 7 can be identified with its image under Ji and we can look on P^^ as on a bundle 
of frames on the contact distribution A on A^. 

3.2. Curves of flags with non-rectangular diagram. 

In this case dim j(*)(A) = dim j(*)(A) + 1 for any -k - I + 1 < i < -k, while j("'="') = 
and dim J^^^"'^)(A) = dim j'^ '(A) + 2. Take a nonzero section e of j(-«^-'+i) and a nonzero 
section / of j(-'=+i) such that J^-^+^\X) = (j(-'=))^^^(A) © {M/(A)}. A pair (6,/) is said to be 
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a principal pair of sections of the curve (2.8). As before, fix a parametrization 93 : 7 i-^ R of 7. 
By Proposition p^ the whole curve of flags (2.8) can be recovered from the sections e and / by 
differentiation and the tuples 

(3.18) (e(t), e'(t), . . . , e(2'=+'-2)(t), /(t), /'(t), . . . , /(2fc+'-2)(t)) 

constitute a moving frame in A(7). This moving frame is said to be corresponding to the pair (e, /) 
and parametrization ip. Fix one symplectic form a from the one-parametric family of symplectic 
forms on A(7). 

We start with the following 



Definition 2. A frame f ei, . . . , e2fc+i-i, fi, ■ ■ ■ , f2k+i~i ) of the symplectic space (A^, a) is said 
to be {k,l)-quasisymplectic if the following conditions hold: 



(1) a{ei, Cj) = for all i + j <2k + 21, a{ei, fj) 
for all i + j < 2k; 

(2) a{f^, e2k+i-i) = i-iy-'' foralll<i<2k + l- 1; 

(3) a{fi,e2k+i+i-i 

(4) a{fk+i, fk+i+i) 



for alli + i <2k + l-l, a{fi, fj) = 



for all2<i<2k + l 
for allO<i<l. 



1; 



As before, first we will fix a parametrization c/? : 7 h^ M of 7. Note that if (e, /) and (e, /) are 



two principal pairs of sections of the curve (2.8), then they are related as follows: 
(3.19) eit) = ai{t)e{t), f{t) = a{t)f{t) + J^ (3i{t)e^'-^\t) 



for some functions q, ai, /5i, /32, • • • , A+i, where a{t) / and ai(t) / for any t. 

A principal pair (e, /) of sections of the curve (2.8) is called a normal pair of sections associated 
with the parametrization (p and the symplectic form a, if the corresponding moving frame (3.18) is 
(fc, ^)-quasisymplectic for any t. In this case the moving frame ( 3.18| ) is said to be normal moving 
frame of the curve (2.8), generated by the normal pair of sections (e, /) and associated with the 
parametrization ip and the symplectic form a. We also say that a germ (e, /) of a pair of sections 
at a point Aq G 7 and the corresponding germ of a moving frame (3.18) at A is normal if their 



representatives are normal for a restriction of the curve (2.8) on a neighborhood of Aq. 



Theorem 1. For any point Aq € 7 the set of normal germs at Aq of a pair of sections associated 
with the parametrization ip and the symplectic form a is not empty. If (e, /) is a germs at Aq of 
a pair of sections associated with the parametrization ip and the symplectic form a, then given a 
nonzero real number C and a set of real numbers {ar^j :0<r< [2])0<i<2Z — 4r} there exists 

a unique normal germ of a pair of sections (e, /) associated with the parametrization p> and the 



symplectic form a such that (e, /) and (e, /) are related by formulas (3.19) with 

l' 



(3.20) 
where to 



a(to 



C, 



/5«+l-2r(*0) 



''i,ri 



VO < r < 



, < i < 2/ - 4r, 



v(Ao 



Proof. The moving frame (3.18), corresponding to a principal tuple (e, /) satisfies condition of 
Definition ^ automatically: the first condition follows from the fact that spaces J^~^'{\) are 
isotropic for z > 1 and from (2.7). If a nonzero section e of j(-«^-'+i) ig fixed, then the condition 
a{f^^-^\t),e^^+^-^\t)) = 1 fixes f{t) modulo {J^-^^)^^\ip-^{t)) for a section / such that (e, /) is a 
principal pair associated with the parametrization (p and the symplectic form a. From here and the 
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fact that j(-i-*)(A) = (J(*)(A))^ it follows by differentiations that a{f'-^\t),e^^^+^~'-^\t)) = 
(—1)*"'^, i.e. condition (2) of Definition ^ holds for the corresponding moving frame (3.18). Any 



two principal pairs (e,/) and (e, /) such that the corresponding moving frames satisfy condition 
(2) of Definition ^ are related as follows 

(3.21) e(t) = --e(t), /(t) = a(t)/(t) + ^ A(t)e»(t) 



a{t) 



i=l 



for some functions a, /3i, /?2, • • • , Pi+i, where a{t) / for any t. 
By direct computations one can easily get the following 

Lemma 2. The condition a (^f'^^^^' (t) ,e''^~^''' (t)) = is equivalent to the following relation: 

(3.22) {2k + 1- l)a'{t) = a(/('=-i)(t), e(^+')(t))a(t) + a{e^^+^-^\t), e('=+')(t)) A+i(i)- 

It is convenient to introduce the notion of weights for sections e, e, /, / and their derivatives, 
functions a, (5i and their derivatives, symplectic products of sections, produced by multiplications 
of these functions on these sections, and products of all of the above. Namely, we set 

(3.23) dege« =deg?^^) = -A;-/ + i + l, deg /^^^ = deg p) = -A: + i + 1 
Further, set 

(3.24) deg ^f ^ =^ / + 1 - i + s, deg a^''^ =^ s. 

Then deg of any object as above will be called the weight or the degree of this object. Finally, 
the weight of the product of objects above is by definition a sum of weights of all its factors and 



for any pair of sections vi, ^2; obtained by multiplication of functions from (3.24 ) on sections from 
(3.23), we set degcr(7;i, ^2) = degwi + degf2. The fact that j(^^+*) = (J^*^)^ can be written in 



terms of weights as follows: for any pair of sections vi and f 2 as above 
(3.25) (T(vi,f2)=0, if degui + degi;2 < 0. 



The reason for the definition of weights is that we want the righthand sides of relations in (3.21 ) 
and their derivatives to be homogeneous of the same degree as the lefthand sides and their 
corresponding derivatives. 

Now assume that (e, /) and (e, /) are two principal pairs associated with parametrization ip 
and the symplectic form a such that the corresponding moving frames satisfy Conditions (1) and 
(2) of Definition p] and they are related by (3.21). Consider the following tuple of sections 



(3.26) 5, = {/(t), . . . , /»(t), e(t), e'(t), . . . , e^'+'\t)} 

Lemma 3. The condition ^{f^ •'^^'{t), f^^^>{t)) = can be expressed as the following differ- 
ential equation w.r.t. the functions [3i: 



l+i 



i=l 



^+■?'~l^ I /^ ^+-?' ^^ fl(2i+i-o 



(3.27, „(*, E ' :;r- , + U:/- 1 ft''"-"« - *. 



where^j is a polynomial expression w.r.t. the functions {[3^ {t)}i<i<ij^i^Q<s<2j+i-i, {a^*H*)}i^o ^' ^ ' 
and symplectic products with positive weights of pairs of sections from Sk+j~i x Sk+j- Moreover, 
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the monomials of^j are quadratic w.r.t. the functions {/3j (i)}i<j</+i,o<s<fe+jj {o^ (*)}i=o '^^^ 
the weights of these monomials are equal to 2j + l|^ 

Proof Replacing fC'+^^t) and J^^+i-^\t) in (j(f^^+^~-^\t)J'^^+i\t)), j > 0, by their expres- 
sion in terms of the moving frame associated with the pair (e, /), functions Pi and a from 



(|3.21 ), we get certain polynomial expression w.r.t. the functions {P^ {t)}i 



<i<l+l,0<s<2j+i-l, 



{a;'*'(t)}™Q "'' ■^ , and symplectic products with positive weights of pairs of sections from 
Sk+j-i X Sk+j- The monomials of $j are quadratic w.r.t. the functions {/3j- (t)}i<j<i+i^o<s<fc+j 



{i)(f\\iain{k+j,2j+l} 



and {a'*'(t)}j^Q . By (3.25), these monomials are nonzero if and only if their coefficients 



have nonnegative weight. Besides the weights of these monomials are equal to 

dega(7('^+^'-i)(t),7(^+^)(t))=2i + l. 
Therefore, if P^ (t) is contained in one of such nonzero monomials, then deg/?^ (t) is not greater 



than 2j + 1. From this and (3.24) it follows that 



(3.28) s<2j + i-l 

If we consider the monomial of a{f^^^'^' (t) , /(*■■+■?) (t)) containing the maximal possible derivative 
of the function /?j(t), i.e. P^ ■^ * (t), then the weight of the other factors in this monomial has to 
be equal to 0. Besides, in the expression of f^ -^'{t) the function Pi ■^ * (t) appears only near 
g(fc+i-i-i)^^^ , while in the expression of f^^~^^~^\t) it appears only near e^^~^''~^~'^\t). Note that 
the only pair of sections in Sk^j-i{t) x {e'-^^'^-'^^^ (t)} having symplectic product of weight is the 
pair (/(''+-'^^)(t),e(''+'"-'^^)(t)) and the only pair of sections in {e^''+'-~^~'^\t)} x Sk+jit) having 
symplectic product of weight is [e^'^^''~'^"'^\t), f^^~^^'{t)). In the both cases the symplectic 
products are equal to (—1)-' and the additional factor in the corresponding monomials is equal 
to a{t) (coming from the term a{t)f^~^^~^'{t) in the expression of f^ ~^^~^\t) and from the term 
(^{t)f {t) in the expression of f^^~^^\t) respectively). From the Leibnitz rule it is not difficult 
to get from here that in the expression of o'{f^^^^^'{t), f^^^\t)) in terms the moving frame 
associated with thew pair (e, /) the monomial, containing /5| ■^ * (t), has the form 

(3.29) (-iF«(*)((^;^r-',)-(2/:^i,))A'^"-"(')- 

This completes the proof of the lemma. D 

Let «B be a (/ + 1) X (/ + l)-matrix such that '^j+i,i = ( ^ -V- - H "^ \2 'V"' - / ) ^°^ ^ •?' ^ ^' 

1 < i < I + 1. For any < p < [j] let 5Sp be a (/ + 1 — 2p) x (/ + 1 — 2p)-matrix obtained from 
!B by erasing the last 2p columns, the first p rows, and the last p rows. 



Lemma 4. a) detOSp ^ for any < p < [ 



^]; 






Binomial coefficients I , with n < k are supposed to be equal to zero in (3.271 
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b) The system of differential equations (3.27) with < j < I w.r.t. the functions {Pi{t)}^t-^^ 
is equivalent to the system of equations of the following form 



(3.30)/3£-_t;'^(*) 



— TTV^r (^{/3;+i_2j(*)}o<i<[V2],0<s<2/--2j-max{2j,2r-l}> a(0 j 



0<r<[//2], 



(3.31)A_2r(i) = ^e, ({/3;+\_2/i)}o<i<[//2],o<s<2r+i-2i, «(*)) , < r < [(/ - l)/2] 

where ^r <ind Qr o'^e polynomial expressions w.r.t. their arguments such that the weights 
of each of their monomials are equal to 21 — 2r + 1 and 2r + 1 respectively. 



Proof, a) First, by direct computations 
(3.32) 



2j + i-lJ \2j + i-l 



2k-i + l / k + j 
k + j [2j + i-lj ■ 



Let DJt ' be a (/ + 1) X (/ + l)-matrix such that its {j + 1, i)th entry is equal to 



k + j 
2j + i-l 



k + j -I 
2j + i-l-2j ' 



or, equivalently, 

(3.33) (071'='')^., = 

Similarly to above, for any < p < [g] let 9Jlp' be a {l + l—2p) x (/ + 1 — 2p)-matrix obtained from 
!B by erasing the last 2p columns, the first p rows, and the last p rows. Since in the factor fTlf 
in the formula (3.32) the indices i and j are separated, it is sufficient to prove the statement a) of 
the lemma for the matrices OJtp' instead of 5Sp. Besides, by definition, it is not hard to see that 

(3.34) "^^'^ 

Denote 

-1)'/! 

^^||(2fe + 2r-lJ 

r=0 

We will prove that 



9Jl«'' = 97t'=+P''-2p. 



(3.35) 



c{k,l) 



{2l-l)\\{2l + 



Jl[2k + 2r-l)\{{k + r). 



yk,l 



yk+l,l-2 



(3.36) ajf"'' = Ck,m'' 

The last formula will imply that OJl'^'' = I I Cfc_|_r,z-2r) which together with (3.34) and (3.35) 



r=0 



will imply the statement a) of the lemma. Formula (3.36) will follow in turn from the following 
statement 

Statement 1. For any s S {1, . . . /} the last column of the matrix OJt ' can he transformed by 
a series of elementary matrix transformations such that the {j,l + l)th entry of the transformed 
matrix is equal to 



(3.37) 



d{k,s,j) 



(-ir 



2J-S-1 



{2s-iy.l{2j 



-jyjl{j-r){2k + 2r-l) [] {k - j + s + r) 



r=l 



r=l 



(while all other columns remain as in VJl ' ). 
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In particular, d(k, s,j) = for 1 < j < s and d{k, 1,1 + 1) = c{k, I). These facts together with 



(3.34) win easily imply (3.36). 

So, to complete the proof of the statement a) of Lemma H^ it remains to prove Statement [11 We 
do it by induction w.r.t. s. To get Statement [T] for s = 1 we subtract the Ith column multiplied 
by k from the {I + l)th column. Namely by direct computations, one has 



m 



k,l\ 



'j,l+l 



A;(9Jl^''),, = d(^,l,j). 



Now assume that Statement [T]is true for s = sq < I and prove it for s = sq + 1. We work with 
the matrix transformed from the matrix 9Jt'^'' as in Statement 111 for s = sq. Using (3.34) and 
induction hypothesis of Statement [l| applied for the matrix gj|^+i!'-2 ^^^^ s = sq — 1, we will get 
that the {I — l)th row of the matrix W^'^ can be transformed by a series of elementary matrix 
transformations such that its {j, I — l)th entry is equal to d{k + 1, sq — l,j — 1) for all 2 < j < I, 
while the (1, / — l)th entry of the transformed matrix is equal to 0, because (QJt*^'^), . = for all 
1 < i < I — 1. After all these transformations, in order to get Statement [T] for s = sq + 1 we add 
the {I — l)th column of the obtained matrix multiplied by 



d{k,so,so + l) 



{2k + l)k 



d{k + l,so-l,so) 2(4^2 



1) 



to its (/ + l)th row. Namely, by direct calculations, one has the following identity 



d{k,so,j) + 



{2k + l)k 
2(4.g - 1) 



d{k + l,so - l,j - 1) = d{k,so + l,j). 



which implies Statement [I] for s = sq + I (note that the transformations we made with the (/ — l)th 
column can be turned back) . With this the proof of statement a) of Lemma E] is completed 
b) Consider the system of differential equations (3.27) with < j < / w.r.t. the functions 



{/9j(i)}i=i- If for given ji < J2 we differentiate 2{J2 — ji) times equation ( |3.27|) wit h j = ji and 
then subtract the obtained equation multipliead by a constant from equation (3.27) with j = J2, 
then we obtain a system of equations 
(3.38) 

/+i 



«(i)E('»)^-.^A 



(2j+i-0 



(i) = cl>,({/3«(t)} 



n<i<l+lfl<s<2j+i-l 



W\t)} 



min{A;+jf,2j + l} 



< j < /, 



where the matrix !B is obtained from the !B by subtraction of jith row multiplied by the same 
constant from the J2th rows of the latter and the functions ^j have the properties similar to 
the properties of functions ^j from Lemma Isj Therefore the system (3.27) with < j < / is 



equivalent to the system of the type (3.38) with matrix !B obtained from the matrix *B by a 



series of elementary transformations with its rows. In this way we apply the Gauss algorithm 
first to the (/ — 2p)th column of 5B killing all entries below the {p+l,l — 2p)th entry step by step 
starting with p = and ending up with p = [-^]- This is possible, because (*B)p+i^i_2p = 1. 
Further, from the statement a) of the lemma it follows that we can apply the Gauss algorithm to 
the (2 {^} + 2p)th column killing all entries below the ([^] + P,2 {^} + 2p)th entry step 
by step starting with p = and ending up with p = [j] . Besides the ( [-j^] + P,2 {-^} + 2p)th 
entries of the matrix, obtained in this way, are not equal to zero. Therefore, the system of 
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equations (3.27) is equivalent to the following one: 
(3.39) 



A-2n(t) = 

(2i-4r2+l) 
n+l-2r2 



< ri < 



1 



a{t) 
l-l 



Qr 



,(^) 



{A?i-?'''^(0}-Lo>{/?f^W}i<.<^+i,o<.<2n+.-.,{a«(i)}-2o^' 



a{t) 



^r 



J {2l-2ir2+j)+l) 
lf^l+l-2j 



m?=-o\ 



ois) 



{/3r(i)}i<.<Hi,o<s</-2.,+.,{«^*Ht)}ro- 



,2l-2r2+l 



< r2 < 



Substitute the righthand side of the first relation of (3.39) with ri = 1 instead of l3i{t) into all 
other equations, then substitute the righthand side of the first relation (3.39) with ri = 2 instead 
of Pi-2{t) into relations with ri > 2 and any admissible r2, and so on up to ri = [-5^]. Then 
in all obtained expressions substitute a'{t) and the higher derivatives of a{t) from the equation 
(3.22), then repeat this procedure recursively until all derivatives of a(i) will be replaced. In this 

. Further, we 

r 



way we get equations (3.31 ) for any admissible r and the equation (3.30) for ^^ = [5 

substitute the righthand side of the second relation of (3.39) with r2 = [2] instead of P'i{t) for 



?(3)/ 



even I and instead of /?2 (t) for odd I into the remaining equations of (3.39), then substitute the 

1 instead of /3j; (t) for even I and 



a 



righthand side of the second relation of (3.39) with r2 

instead of P2 (*) fo^' odd I into the remaining equations of (3.39 ), and so on. Then as before in all 



obtained expressions substitute a'(t) and the higher derivatives of a{t) from the equation (3.22) 



then repeat this procedure recursively until all derivatives of a{t) will be replaced. In this way 



we get equations (3.30) for all remaining admissible r. The proof of the statement b) of Lemma 
|4]is completed □ 

The statement of Theorem [T] immediately follows from the system of the differential equations 
w.r.t. a{t) and /3i_|_i_2r(i) with < r < [1/2], consisting of equation (3.22) and all equations 
(Ool). D 



As in the case of the rectangular diagram the curve (2.8) (or equivalently the curve 7) can be 
endowed with the canonical projective structure, but its construction depends on vanishing or 
nonvanishing of certain relative invariant of the curve. 

Fix a symplectic form a from the one-parametric family of symplectic forms on A (7) and a 
parametrization ip : 7 1— > M of 7. Let t = (p{X). To define the mentioned relative invariant note 
that by Proposition 



'i 



we have e^^\t) G jC-^-'+^+i) 
1 



if ^(t)). Moreover, 



=0 



1. 



(3.40) j(-k-i+i+i) ((^-i(t)) = span{e^^>{t)}j 

Since spaces J^^\X) are isotropic for i < and J^^^^ = (j(°))^, we get a[e^'^\t),e^^^^\t)) = for 
all < z < A; + / — 2. On the other hand, the quantity cj(e'^+^~^^(t), e'^"'"''(t)) is not necessary 
equal to 0. Set 

where t = ip{X). The quantity /o('^) depends on a choice of a nonzero section of jl^^^'+i)^ a 
parametrization of 7, and a form a but it is just multiplied by a positive scalar when one goes 
from one such choice to another one. So, the quantity /o('^) is a well defined relative invariant of a 
curve (2.8) at A, i.e. Io{X) is either zero or nonzero, independently of a choice of a nonzero section 
of j(-«^-'+i) and a parametrization of 7 (moreover, its sign is preserved as well). Our construction 
of a canonical projective structure is different in the cases /q 7^ and Iq = 0. However, as we 
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will see later, this branching in the construction of a canonical projective structure does not make 
any influence on the constancy of the symbol of the obtained frame bundles and therefore on the 
prolongation procedure for them. 

a) Canonical projective structure in the case Iq = 0. Given a normal pair of sections 
(e, /) associated with a parametrization y? of 7 and the symplectic form a let 

(3.41) /,2,^(A) = a(e('=+')(t),/W(t)), t = ^(A). 

Note that P2,ip{^) does not depend on a choice of normal pair (e, /) . The transformation rule of 
P2,ip under a reparametrization of 7 is similar to (3.16) Indeed, let ipi be another parametrization 
and V = If o if^ . Then it is not hard to show that p2,ip and P2,ipi are related as follows: 

P2,^,(A) = v'{Tfp2A>^) + CliSiv)ir), r = M>^) 

where, as before, S{v) is the Schwarzian derivative of v and C^^ is a nonzero constant. 
The set of all parametrizations ip of j such that 

(3.42) p2,^ ^ 

defines the canonical projective structure on 7. 

b) Canonical projective structure in the case Iq 7^ 0. As a matter of fact in this case 
there is much more simple way to construct distinguished moving frames for a curve of flags (2.8). 
Indeed, given a parametrization tp and a symplectic form a there exists a unique section e of 

|a(e('=+'-i)(t),e('^+^)(t))| = l, 

i.e. the absolute value of the relative invariant Iq for such choice of section of jl^'^^'+i). ig equal 
to 1. 

Lemma 5. Among all sections of J^~^^' there is a unique section f such that (e, /) is a principal 
pair of section of the curve (2.8) and the following relations hold: 

(3.43) a(/('=-i)(t),e(^+'~i)(t)) =1, 

(3.44) (j(/('=-i+j)(t),e('=+')(t)) =0 VO < i < / 

Proof. Take a section / of the bundle j(~'^+^) such that (e, /) is a principal pair of section of 
the curve ([2^. The condition a{f(''-'^\t),e^''+^-^\t)) = 1 defines / modulo (j(-''))^^\ Further, 
taking into account that Iq ^ 0, it is easy to see that the condition (T(/''^~^'(t), e(^+')(t)) = 
defines / modulo j'~". More generally, the conditions 

a{p-'+^\t),e(''+^\t))=0, 
for < j < i, defines / modulo J^"*"'"*). Our lemma follows from the fact that j(~^~') = 0. D 
Take the section / from the previous lemma and let 

(3.45) />3,^(A) = a(/('=-i)(t),/('=)(t)), t = v^(A). 

The transformation rule for p^^ip under a reparametrization of 7 is similar to (3.16). Indeed, let 
ipi be another parametrization and v = ip o ip^ . Then it is not hard to show that ps^^ and />3,(^i 
are related as follows: 

P3,^i(A) = v'{rfp3,^{X) + ClMv){r), r = pi{\) 
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where, as before, S(f) is the Schwarzian derivative of v and C|; is a nonzero constant. The set 
of all parametrizations (f of ^ such that 

(3.46) p3,^ = 

defines the canonical projective structure on 7. 

Now let, as before, A^ be a manifold of all leaves of the characteristic foliation C in a small 
neighborhood of a point Aq G FD-^\F{D'^)-^ such that the linearizations of the flag {J'^'^'} along 
any leaf of C in this neighborhood has the Young diagram T of type {k, I), where / > 0. Consider 
a fiber bundle P^^i over N such that its fiber over a point 7 is a set of tuples (7, ip, a, (e, /)) , where 
ip is a, projective parametrization of the leaf (the abnormal extremal) 7 , a is a symplectic form 
a from the one-parametric family of forms on A(7), and (e, /) is a germ of normal pair (e, /) of 
sections associated with the parametrization (p and the form a. In contrast to the bundles Pkfl, 
this bundle has no structure of a principal bundle. On the other hand, on each fiber of this bundle 
there is a distinguished global frame. The vector fields of this frame play the role of fundamental 
vector fields in the case of principle bundle. They do not constitute a basis of a Lie algebra but 
this fact is not important for our further constructions. 

Let us construct these vector fields. Note that each fiber of Pfc,z over a point Aq is foliated by 
a corank 3 foliation Fol such that each its leaf corresponds to a fixed projective parametrization 
if such that vf~^{0) G A^. First we will construct a global moving frame on each leaf of this 
foliation. For this fix a point Fq G Pa:,«) Tq = (7, (p, cr, (e, /)) . For any < f < [5] , < i < 2/ — 4f 
let s — > Tr,i{s) be a curve on the fiber of Pk^i over 7 such that the point Tr,i{s) corresponds to the 
parametrization ip and the symplectic form a but the germ of normal pair (e, /) , corresponding 



to Tr^i{s), is related to the pair (e, /) by (3.21 ) with the the functions a, Pi, ... , /3;+i satisfying 



(3.47) a(0) = l, Plt^orM = 6adr,fS, VO < f < 



, < i < 2/ - 4r, 



where 6ij is the Kronecker index. It is clear that Tr^i{0) = Fq. Define the vector field 'Pr,i as 
follows: Vr,i(^o) is the velocity of the curve Fr,j at s = 0. Further, let s — > Hi(s) be a curve on the 
fiber of Pk^i over 7 such that the point Hi(s) corresponds to the parametrization 99, the symplectic 
form a, and the germ of normal pair (exp'* e,exp~'* /) associated with the parametrization ip and 
the form a. Obviously, Hi(0) = Fq. Define a vector field Zi such that Zi(To) is the velocity of 
the curve Hi at s = 0. Finally, let s -^ ^2(5) be a curve on the fiber of Pk^i over 7 such that the 
point ^2(5) corresponds to the parametrization </?, the symplectic form ag = exp~'^^a, and the 
germ of normal pair (exp'^ e, exp* /) associated with the parametrization ip and the form ag. By 
construction, ^2(0) = Fq. Define a vector field Z2 such that Z2(Tq) is the velocity of the curve Si 
at s = 0. The tuple of vector fields ({'Pr,i}o<r.<ril o<j<2«-4r'^i' ^2) constitute the global frame 
on each leaf of the foliation Fol. 

To complete it to a frame on the fibers of Pk,i first note that if a point Fq = (7, 93, o", (e, /)) 
lies in P^^i then the points F(s) = (^■j,ip{-) — s,(T, (e,/)) belong to P^^i (here we replace the 
parametrization (p by its shift (p(-) — s for a constant s). Define a vector field X such that Af(Fo) 
is the velocity of the curve s — > F(s) at s = 0. Further there exists a natural action of the 
group of real Mobius transformations preserving (~ ST(2, M)) on the fibers of Pfc,z- Indeed, take 
first a Mobius transformations v preserving and ,as before, take a point Fq G Pk,i such that 
To ~ (7)95,(7, (e,/)). By direct computations, one can show that if the pair (e(A),/(A)), A G 7, is 
a normal pair of sections associated with the parametrization ip and the symplectic form a, then 
the pair 

(e„(A),/„(A)) = (t;'(r)-('=+'/2+i)e(A),z;'(r)-(^-+'/2+i)/(A)) 
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with r = v^^oipl^X), A S 7, is a normal pair of sections associated with the parametrization v~^oip 
and the symplectic form a. Then we set that v acts on the fiber of Pk^i over Aq by sending Tq 
to the point (^Xo,v~^ o ip,a, (e„, fv))- This defines the action of the group ST(2,M) on the fibers 
of Pk^i- Then any choice of a basis {H,Y) of the corresponding Lie algebra st(2,M) defines two 
more vector fields 7i and y on the fibers of Pk.i which together with the vector field X complete 
the tuple ({'Pr,i}o<^<rii o<i<2«-4r' ^i' ^2) to the frame on these fibres. 

Now to any point T G P^^i, where T = (7, ip, a, (e, /)) , assign the frame S^2(r) on ^(7) at the 
point ip~^{0) of normal moving frames of the curve ( |2.8[ ) generated by the pair (e, /) and associated 
with the parametrization ip and symplectic form a. In contrast to the case of rectangular diagram, 
we cannot claim that the mapping ^2 are injective but we have the following 

Proposition 4. The mapping ^2 is an immersion. 



Proof. Let, as in the Introduction, y be a vector spaces, endowed with the filtration vector (1.1 ) 
and with the distinguished basis {ei, . . . ,e2k+i-i, fi,- ■ ■ , f2k+i-i) satisfying conditions (1) and 
(2) of subsection 1.1 b). Then any frame T on A (7) can be identified with the isomorphism 
T : y — > A(7) sending the distinguished frame of V to the frame T. Further, any vector A 
belonging to the tangent space at T to the set of all frames on A(7) can be naturally identified 
with an element 2a of 0[(V^). Indeed, if s ^ ^{s) is a smooth curve of frames on A(7) such that 

T(0) = T and T'(0) = A then let Ia = '^^^ ° ^T(s)|s=o- So, any vector field B on P^^i tangent to 
its fibers defines the mapping Is from Pk^i to ^[(V^) which sends a point Tq S Pk,i to the operator 

From the constructions it is easy to see that for the vector fields Zi, Z2, X, 7i, and y the 
corresponding mappings Izi, Iz2i ^x^ ^n, and ly are constant, i.e. do not depend on points of 
Pk^l- This is not the case for the mappings corresponding to the vector fields Vr,i- On the other 
hand, the filtration on V induces a natural filtration on Qi(V), i.e. a nondecreasing (by inclusion) 
sequence of subspaces qI{V)^^' of qI{V) such that 

(3.48) 0l(F)» = {Ae gl{V) : if v e y(^) then Av e yO+^)}. 

We say that the operator A G qI{V) has the weight (or degree) equal to i if A is in qI{V)^'''' but 
not in 0[(y)(^-i) 

Lemma 6. The operators X-p^.(p) corresponding to the vector field Vr,i have weight equal to 

—2r — i. The equivalence class of the operators T-p^ .iy\ in 0[(y)^^^''^'Y0K^) * ""^ '^''^■^ ^^^ 

depend on F G Pk^i. 

Proof. Take two points Fo,F G P^^u where Fq = ['j,(p,(T,{e, f)) and F = (7, (/7,(T, (e, /)). Let 

(ei(t), . . . , e2k+i-i{t), fi{t), . . . f2k+i-i{t)) and (ei(t), . . . , e2fc+/-i(t), /i(i), • . . f2k+i-i{t)) be the cor- 
responding moving frames over 7, where t = 'p{X), A G 7. Namely, ei{t) = e^'^~^'{t), ei{t) = 
e^'~'^\t), fi{t) = f^'-^\t), and fi{t) = f^'~^\t). The pairs (e,/) and (e, /) are related by ^M\ 
for some functions a, /?i, . . . , A+i, where a(0) = 1. 

Let us study how the the vectors fj{t) are expressed by the frame (ei(t), . . . , e2k+i-iit), /i(0; • • • 
f2k+i-i{t))- For this first note that e2^_,_;_^(i) G J^''~^>[(p~^{t)). Indeed, from the condition (1) 
of the definition of the (A;, /)- quasisymplectic frame it follows that a[ei{t), e2k+i-i{t)) = for any 
1 < i < / + 1. Then by differentiation o"(ej(t), 63^ , ^_-|^(t)) = for any 1 < i < I. RecalHng that 
j(-'=)(^"i(t)) = span{ej(t)}'^i (see ^AOp and that {J^-''Y{(p-\t)) = J^^~^\<f-^{t)) by ^ 



we get e'2fc^,_i(t) G J^^~'^\ It implies in turn that e^],^_^j_-^(t) G ji'^+J-'^). 
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Assume that for 1 < j < I 

2k+l-l 2k-2+j 

(3.49) 4ViW= E ^jpWepW+ E Cjpit)fp(t)- 

p=l p=l 



In order to make both sides of (3.49) to be homogeneous of the same degree, in addition to weights 
defined above, let us define weights (or degrees) of functions S,ji{t) and Cjj(^) ^^^ their derivatives 
as fohows: 

(3.50) deg^^'J{t) = s + 2k + l+j-p-l, degC^/J{t)=s + 2k + j-p-l. 



Differentiating (3.21) j — 1 times and making, if necessary, appropriate substitutions from 
( 3.49[ ), we get 

j-l 2k+l-l 

fj{t)=a{t)fj{t) + Y,f^Jp{t)fp{t)+ E M*)ep(t) 
p=i p=i 

where functions Xjp are polynomial expressions with constant coefficients w.r.t. the functions 
f3s{t), ^sp(i) and their derivatives, functions f^jp{t) are polynomial expressions with constant co- 
efficients w.r.t. the derivatives of function a{t) and functions Ps{t), Csp{t) and their derivatives. 
In all these expressions substitute all functions (3i-2rit) (and their derivatives) by the righthand 
sides of ( |3.31| ) (and their derivatives). Then substitute (also recursively, if necessary) all functions 

a{2l-4r+iy7~r, , , i ■ , ■ , ■ \ i , i ■ i , i , ■ , r J o o^ l. / t , i ■ , ■ , ■ n i 



/3;+i_2r (^) (and their derivatives) by the righthand sides of ( |3.30 ) (and their derivatives) and 



all derivatives of a(t) by the righthand sides of (3.22) (and their derivatives). After all these 
substitutions we will get finally that all function Xjp{t) and fJ-jp^t) are polynomial expressions 
w.r.t. the functions 

(3-51) W+l~2A*)}o<r<[l],0<i<2l-4r ' 

such that the coefficients of their monomials are in turn polynomial expressions with universal 
constant coefficients |J w.r.t. symplectic products with positive weights of pairs of sections from 

the set \ {es{t)}l^^~^ , {fs{t)}l^''~^} > and functions a (,sip, Cs2pi and their derivatives. Note 

that by our construction the weights of the functions ^^ip and Cs2P ^^^ positive. Therefore by 

comparison of weights the function /3}^\_2r(i) cannot appear in the expression for Xjp{t) with 

degep(t) - deg fj{t) > -deg/3j;\_2,(t) = -2r - i. 



By (3.23) the latter is equivalent to the relation p>j + l — 2r — i. Further, for p = j + 1 — 2r 



in the polynomial expression of \jp{t) w.r.t. the tuple (3.51 ) take the coefficient of the monomial, 
containing only the function /3}l\_2r(^) (and not its power or other functions from the tuple 



(3.51)), if it exists. Then the weight of this coefficient is equal to zero. Therefore this coefficient 
is a polynomial w.r.t. the function a{t) with universal coefficients rl Let Urij be the value of this 
polynomial at i = 0. Note that this constant is again universal. 

Besides, in the polynomial expression of fJ^jp{t) w.r.t. the tuple ( |3.51 ) the coefficient of the 

monomial, containing only the function /?;l\_2r(0) ^as positive weight, because each monomials 

By universality of the constants we mean that they are the same for any curve of flags with the fixed Young 
diagram. 

It can be shown that this coefficient is equal to a{t) multiplied by a constant. 
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of this coefficient contains either derivatives of a{t) or functions Csp{_t) or their derivatives. Hence 

the function /?|l\_2r(^) cannot appear in the expression for \jp{t) with p>j + l — 2r — i. 
All this implies that the operator Ip^.m^-j satisfies the following relation: 

(3.52) ^P.„(ro)(/i) = U„,ej+i.2r-i modV^~''+^-^'^-'-'\ 
By the similar arguments, one gets 

(3.53) ^P.,(ro)(e.)e^^-'-'+^"'^'--'-'^- 

Taking into account that e,- G l/(-'=-^+i) and /,■ G \/(^^+i)^ we obtain from (3.52)-(3.53) 



that Xp^ .(Pq) G gl(y)(~^''~*) and that the equivalence class of the operator Xp^ .(r^-) in the space 
0l(F)'^~^^'*V5K^)*'^^'^~*~^'' "io^s not depend on Tq G Pk,i- To complete the proof of the lemma it 
remains only to show that T-p^, .(p^j) ^ g[(y)'~-^''"~*~^) or, equivalently, that given a pair (r, i) the 
constant Urij does not vanish for at least one pair j. From universality of the constants Urij it is 
sufficient to check only for one curve of flags with the given Young diagram. We shall consider 
the flat curve ^k,i, defined in the Introduction, as a simplest possible case. 

Directly from the definition it follows that for the flat curve the functions S,jp{t) and Cjpi^) from 
(|3.49) vanish. Besides, in section 4, Theorem 2, it will be shown that for the flat curve any normal 



(quasi-symplectic) frame is symplectic. Therefore, symplectic products with positive weights of 
pairs of sections from the set < {es}^^ ~ ,{fs}s^ "if vanishes as well. This implies that for 
the flat curve the operator T-p^ .(Po) satisfies 

(3 54) f ^^..(ro)(ei) =0 

I ^Vr,r{To){fj) = Urijej+i_2r-i- 

So, if Urij = for any j, then 2p^ .(p^) = 0, but the latter is impossible. Indeed, let Foli be a 
subfoliation of Fol such that the points of the same leaf of Foli correspond not only to the same 
projective parametrization of 7 , but also to the same symplectic form a from the one-parametric 
family of forms on A(7) and the same first section ei(t) from the normal pair of sections. In the 



,[«/2] 



flat case equations (3.30) w.r.t. the functions {Pr{t)}r=d ^-^e linear. Therefore each leaf of the 
foliation Foli has natural affine structure. The mapping ^2 sends the leaf of the foliation Foli 
passing through the point Fq to the set of frames on A (7) of the type 



2k+l-l 



{{e.(0)}^^+'^M/.(0) + Yl \spepmf=V~'}, 



p=i 

which also has natural affine structure. Besides, it is clear that in the flat case the mapping ^2 
is affine on each leaf of Foli . From the proof of Theorem 2 below the dimensions of the image of 
this leaf w.r.t. 5^2 is equal to the dimension of this leaf. In particular, this implies that in the flat 
case the restriction of 5^2 to each leaf of Foli (and therefore 5^2 itself) is an immersion. Since the 
tuple of vectors {'Pr,i(ro)}o<r.<ril o<i<2i-Ar span the tangent space at Fq to the leaf of Foli passing 

through Fq, we get from here that /p^ ,(pg\ 7^ 0. This completes the proof of the lemma. D 

The previous arguments also shows that the mapping ^2 is an immersion. D 
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4. Prolongation of filtered frame bundles on corank 1 distributions 

4.1. Graded ske^v-symmetric forms, symbols, and VF— structures. Collecting together 
the common features of both cases considered in the previous section, we arrive naturally to the 
following abstract setting. 

Let A^ be a smooth manifold endowed with a bracket-generating distribution T) of corank 
1. On each subspace T>{x), x G A^, a skew-symmetric bilinear form uJx is defined, up to a 
multiplication by a nonzero constant: uJx = da{x)\'QM: where a is a nonzero one form, annihilating 
the distribution T). Note that we do not assume that the distribution 1) is contact so the form cox 
is not symplectic in general. As in the symplectic case, a subspace A of 2)(x) is called isotropic 
(w.r.t. the form ujx), if u!x\a = 0. Also, given a subspace A C S)(x), denote by A^ = {u G S)(x) : 
^x{v,i) = V£ G A}, the generalized skew-symmetric complement of A. 

Further let y be a vector space of dimension dim A^ — 1 (equal to rank of 2)) endowed with a 
filtration 

(4.1) V = y(^) D y(^~^) 5 ... 5 y(--f-i) d . . . d y("^i) = o. 



Also assume that V is endowed with a distinguished basis compatible with the filtration (4.1). 
Denote by F(S)) the bundle over Ai of all frames of S. It can be identified with the set of all 
isomorphisms (px'- V ^ 2)(x), x £ M: to any frame Tl{x) one assigns the isomorphism (px, which 
sends the distinguished basis of V to this frame. Further, let Fv'(S)) be the subbundle of F(S)), 
consisting of all frames (px of 1) such that the following two conditions hold 

(1) each subspace 4>x{V^''>) with i < is an isotropic subspace of S(x) w.r.t. the form Ux] 

(2) (pxiV^''^'^^) = Ux{V^''')) for any -1 - / < i < I. 

In the other words, the mapping (px G Fy(S)) induces a well defined, up to a multiplication 
on a nonzero constant, skew-symmetric bilinear form u;,^^ = (px^x on V such that subspaces V^^^ 
with i < are isotropic and y'^*^-"^) = (y'*))^ for any i G {— / — 1, . . . , /} w.r.t. cD,^^. Besides, 
the form uj^^ induces the skew-symmetric bilinear form tj0j.,gr on the graded space 

(4.2) gTV= (y«/y(^-i)) 

i=-fi+l 

in the following way: assume that x G T/Wi)/!/^!"^) and y G yw2)/y(i2-i)^ then 

(1) if ji + J2 = 0, we put LUfj,^^g,.(x,y) = LUfj,^(x,y), where x and y are representatives of x and 
y in V^^^'{t) and V^^'^'{t) respectively; 

(2) if ii + J2 = 0, we put a;0^,gr(x, y) = 0. 

Let P be a fiber bundle over M endowed with the fixed fiberwise immersion ^ to Fv(S)). One 
says that a fiber subbundle P of Fv'(S)) has a constant graded skew-symmetric form if the forms 
cjj(p) gi- are the same, up to a multiplication on a nonzero constant, for all p £ P. For a rank 
3 distribution D of maximal class and with the fixed diagram T as manifold Ai we take the 
manifold N, as a distribution 2) we take the distribution A and as the bundle P we take the 
bundles P^,/ for the corresponding k and /. Note that by our constructon the bundles Pk^i have 
constant graded skew-symmetric form for any k and /. 

Further, let Px = 7r~^(x) n P be its fiber over x. Using the identifications above and the 
immersion ^, one gets that the tangent space Tp(P^rp\) to a fiber P-„-(p) at a point p can be 
identified with a subspace of 0l(l^), which will be denoted by Wp. Indeed, to any vector A 
belonging to Tp{P^ip\) we assign an element Ia of 0[(^) ^^ follows: if s ^ p{s) is a smooth in 
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P such that p(0) = p and p'(0) = A then let Xa = 5(p)^^ ° ^5^(p(s))|s=0) where in the last 
formula by ^{pis)^ we mean the isomorphism between V and 2)(7r(p)) corresponding to the frame 
5'(p(s)). Set l^p = {Ta '■ A G Tp{P^(^p^)}. By analogy with the previous section, the filtration 
( |4.1[ ) induces a natural filtration on 0[(V^) and, therefore, on any its subspace. The corresponding 
graded subspace gr Wp is called a symbol of the bundle P at a point p. Symbols are subspaces 
of grgl(y), which in turn is naturally identified with Ql^giV). We say that the bundle P has 
constant symbol if its symbols at different points coincide. 

In the sequel we shall deal only with fibre bundles P as above having constant graded skew- 
symmetric form and constant symbol. We denote this graded skew-symmetric form on gr 1/ by tt) 
and the symbol gr Wp by s. Note that by our construction the form m is not identically zero. 

Definition 3. Let P be a fibre bundle endowed with the fixed fiberwise immersion 5' to ^^(2)) 
and with constant symbol s. Let W be a filtered linear space such that the dimensions of the 
spaces of its filtration are equal to the dimensions of the corresponding spaces of the filtration of 
Wp (= Tp{P^fp\)). P is called a W -structure of frames on 1), if the filtered tangent spaces Wp to 
fibers of P at different points are identified together with filtrations on them or , more precisely, 
if a smooth family {V'plpeP of isomorphisms ^p : W ^ Wp, preserving the filtrations, is fixed. 

If the subbundle P is a reduction of the bundle Fy(23) to a subgroup G of GL{V) with the 



Lie algebra g, then P is automatically a g-structure: the filtration (4.1) induces a filtration on 
g and the symbol of P is nothing but grg; the spaces Tp{P^i^p-^) are naturally identified with g. 
This situation occurs for a rank 3 distribution with a rectangular diagram T. In this case the 
structure group is isomorphic to 5T(2,]R) x GL(2,M). In the case of nonrectangular diagram the 
corresponding bundle Pk,u I > 0) has constant symbol by Lemma |6j Moreover, as was shown in 
the previous section, on each fiber of P^^i there is a distinguished global frame, which is equivalent 
to the fact that the filtered tangent spaces Wp to fibers of P^^i at different points are identified 
(and also together with filtrations on them). So, Pk^i is a ly-structure as well. 

4.2. Prolongation procedure. In the sequel for simplicity of presentation we suppose that 
vr: P ^ 7W is a VF-structure, which is a fiber subbundle of ¥y{Ti). All constructions are general- 
ized to arbitrary M^-structures in an obvious way. We also assume that P has a constant graded 
skew-symmetric form on 55. Let T)^^' = 7r*2) be the puUback of T) by the projection vr. One can 
define the partial soldering form on D^^-*, i.e., a field of linear maps 9p : S)*-^'(p) ^^ V oi F- valued 
partial one- form on S*-^^ given by: 

ep{X) = {p)-\dp7r{X)), X G S)(^)(p), 

where, as before, a point p G P is identified with an isomorphism p\ V ^ 2)(7r(p)). 

Consider a bundle Q over P with a fiber Qp over a point p, consisting of all subspaces, which 
complete the spaces Wp = kerdpvr to 'S)^^'{p). That is: 

Qp = {Hp c S)(i)(p) \Hp®Wp = S)(^)(p)}. 

Note that the partial soldering form 9 defines an isomorphism of Hp with V for any horizontal 
subspace Hp. Fix a point q G Qp, q = Hp and a pair of vectors vi and V2 in V . Take two vector 
fields Yi and 12 in a neighbourhood U of p such that 0(Yi) = Vi in U and Yi(p) G Hp for i = 1,2. 
Set 

(4.3) mg{vi,V2) = dp7T{[Yi,Y2]{p)). 

It is clear that the vector ^q{vi,V2) G r^(p)A4 does not depend on a choice of a pair of vector 
fields Yi and Y2 with the properties prescribed above. 
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Given a vector v & V define a vector grt; in the graded space gr 1/ as follows: if w G V^'^', but 
V ^ V^^~^', then gr w is an equivalence class of v in T/(*)/y(*~^). By our constructions there exists 
two vectors vi and V2 in V such that 

(4.4) n3(grui,gri;2) / 0, 

where, as before, W is the graded skew-symmetric form on gr V, associated with our bundle P. 



Condition (4.4) implies that 

(4.5) (^p{vi,V2) ^ for any p, 

where, as before, iOp{vi,V2) = da[p{vi),p{v2)) for some nonzero 1-form a, annihilating the dis- 
tribution J). The condition ( |4.5[ ) is in turn equivalent to the fact that the vector ^q{vi,V2) is 
transversal to 2)(7r(p)). 

Further, define a vector space V = V (B Mr/ for some vector rj. Then given a point q £ Qp one 
can define an extension of the isomorphism p: V ^^ S (^(p)) to an isomorphism Xg • ^ '"^ T^(p)^ 
by setting Xqiv) = ^{q){^1i ^2)- Finally, let pr : 1/ 1— > F be the canonical projection corresponding 
to the splitting V = V (B Mr/. Then we can define the structure function C: Q ^ Hom(A^y, V), 
associated with a pair of vectors vi and V2 as follows: 

(4.6) C((?)(t;i,t;2)=pro(:>t<?)"'(%(^i,^2)). 

Now take Hp and H' in Qp. How C{Hp) and C{H') are related? First, recall that Hp and H' 
are subspaces in S*^^^(p) complementary to the tangents space Wp to a fiber of P at a point p. 
Then we have a well-defined map: 

5{H'p,Hp):V ^Wp, 

such that 

(4.7) X + 5{H'p, Hp){e{X)) G H'^ for each X (^ Hp. 

It is easy to see that the set of all subspaces at p G P, which are complementary to Wp in 2)(p), 
forms an affine space associated with a vector space Hom(y, Wp)., i.e., Q is an affine bundle over 
P. 

Second, recall that the Spencer operator Sp of a pair (F, Wp), where T^ is a vector space and 
Wp is a subspace of 0l(F) is defined as follows: 

Sp-. Hom(y, Wp) ^ Hom(AV, F), </< ^ 5p(0), 

Sp{(l)): Ui AU2 "-^ '^(i'i)w2 - </'(f2)''^l, f^i,f^2 G ^• 

Now assume, as before, that y is a vector space, vi and V2 are vectors in V, ujp is a skew- 
symmetric form on V such that cjp(T;i,z;2) 7^ 0, and VFp is a subspace of 0[(^). To the quintuple 
{y.,vi.,V2,0Jp,Wp) we assign a modified Spencer operator Sp in the following way: 

5p : Hom(l^, Wp) -^ Hom(A V, V), (/) ^ Sp{(t)), 
('^•^) Q I \/ ^ G ( \i \ ~i ^Sp{<.p){vi,V2) 

Sp{Lp){Vl,V2) = Sp{ip){Vl,V2) -U}p{Vl,V2) ^ ,_ _ . ■ 

bJp{vx,V2) 

Then by direct computation one can show that 
(4.10) C{H'^) = C{Hp) + Sp{5{H;, Hp)), 
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where S{H'p, Hp) is as in (4.7). The classical first prolongation Wp of the subspace Wp C qI{V) is 
defined to be the kernel of Sp. The modified first prolongation Wp of the subspace Wp C Qi{V) 
is defined to be the kernel of Sp. In both cases Wp and Wp are subspaces of Qi{V, Wp). It is 
clear that W^,^^ C VFp^^™). 

Note that the modified Spencer operator depends on a choice of a pair of vectors vi and V2 



in V, satisfying (4.4). The amazing thing is that the modified first prolongation Wp does not 



(Im) 



depend on a choice of a pair of vectors vi and V2 in V, satisfying (4.5). This is because if one 
takes another pair of vectors vi and V2 in V such that ujp{vi.,V2) 7^ and ip G Wp ™ , then by 



(4.9) 



Sp{ip){vi,V2) _ Sp{ip){vi,V2) 



^p{vi,V2) ^pivi,V2) 

One can describe the modified first prolongation Wp ™ in more symmetric way as follows: 

%^^™^ = {v? G Hom(y, T^p) I u;p{vi,V2)Sp{ip){vi,V2)-uJp{vi,V2)Sp{ip){vi,V2) = 0,Vfi,f2,^i,^^2 S V} 

Besides, there is another convenient characterization of the modified first prolongation: 

(4.11) W^'^"^^ = W^ Rom{V,Wp) \3veV such that Sp{ip){vi,V2) = i:jp{vi,V2)v V^;i,V2 G V} 

More generally, as in the classical theory of prolongations, one can define the modified Spencer 
operator and the modified first prolongation also for a subspace 21J of Hom(y, Vi), where Vi is 
some linear space not necessary equal to V as before. In this case the Spencer and the modified 
Spencer operators are operators from IIom(y, 2)3) to IIom(y A y, 14) and they are defined by the 



same formulas, as in (4.8) and (4.9). The modified first prolongation is a kernel of the modified 



Spencer operator. There is also a description of the modified first prolongation analogous to 



(4.11), where we can consider Wp as a subspace of Hom(y, Vi) and take v from Vi. This slight 
generalization allows us to define inductively the modified higher order prolongations of Wp. 

Indeed, by construction Wp ™ C iloui{V,Wp). So, taking Wp as Vi, one can define 

More generally, for any i > we can consider Wp^ as a subspace in IIom(y, Vi) with Vi = 
W!,^'-'^""^ and set by induction H^«'+^)'") = {wi'^'Y'^^ ■ 

Lemma 7. Suppose that W is a suhalgehra in csp(y) and A\m.W > 4. Define a graded nilpotent 
Lie algebra 0_ = 0_2 + 0-i, where g_2 = Mr/ for some element -q, 0_i = V and the Lie bracket 
given by [vi + air],V2 + 02?]] = uj{vi,V2)r]. Set go = ^ a^c^ l^t = Z]j>_2S« ^^ ^^^ Tanaka 
prolongation of the pair (fl-, So)- Then the p-th modified prolongation W^^"^' of W coincides with 
the subspace Qp in the Tanaka prolongation for any p >0. 

Proof. According to [10] the subspace g.j+i in the Tanaka prolongation is defined inductively as a 
set of all linear maps (/> of degree i + 1 from g_ to Yl]=-2 0i such that 

(4.12) (/)([xi,X2]) = [(/'(xi),X2] + [xi,(/)(x2)], for all xi,X2 G 0-. 

It is clear that any such map (p is uniquely defined by its restriction ■0 to g-i. Let v = <j){r]) £ Qi-i. 
Therefore, using induction, one can consider flj+i as a subspace in IIom(g-_i,3j). Substituting 
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xi = vi, X2 = V2, ui,V2 £ V into equation (4.12) we get the following linear equation on a pair 
(4.13) 



UJ{VI,V2)V = [lp{vi),V2] 



{v2),vi], for all i;i,t;2 G y = 0-1. 



This equation coincides with equation (4.11) on the modified prolongation q 

(Im) 



(Im) 



of Qi. It implies 



that 0j+i is contained in q- 

In order to prove that these spaces are equal it is sufficient to show that if (/> is a linear maps of 
degree i + 1 from g_ to Yl)=~25j such that(4.12) holds for any 2:1, 2:2 G 5-i(= V), then it holds 
for any xi,a;2 G 0-. It is trivial for xi = X2 = rj. So, it remains to consider only the case xi = rj 
and X2 = z £ V. Since [q, z] 

(4.14) 

Let us prove (4.14). Since dimV > 4, we can choose x and y in V such that [x,y] = tj and 
[x,z] = [y,z] = 0. Then, using (4.12) for vectors from V, we get 

(4.15) [(Piv),^] = [[(t){x),y],z] + [[x,(l){y)],z] = [(t){x)y,z] - [(l){y)x,z] 

(4.16) [r/, 0(z)] = [[x, <P{z)],y]] + [x, [y, 0(z)]] 

Since cj){x) £ Qi and [y,z] = 0, we have [(j){x)y,z] = [(f)(x)z,y]. Similarly, [(j){y)x,z] = [<j){y)z,x]. 



0, in this case (4.12) is equivalent to 



Substituting this to (4.15), we get 

(4.17) [(/>(??), ^] = [<p{x)z, y] - [0(y)z, x] 

Further, since (4.12) holds on V and [x,z] = 0, then [x, (^(2;)] 
[y,(j){z)] = [z,(p(y)]. Substituting it to (4.16) we get 

[r],(t>{z)] = [[z,<t>{x)],y 



[z,(p(x)]. In the same way, 



(4.18) 



+ 



x,[2,<P{y)] 



x)z,y] + [(j){y)z,x] 



Identity (4.14) follows from (4.17) and (4.18). This completes the proof of the lemma. 



D 



Remark 1. Note that the last lemma does not hold for diml/ = 2, as condition (4.11) becomes 



trivial in this case, and we get VK^^"*) = IIom(y, W). In particular, if VF 7^ 0, then VK^*"^) is also 
non-zero for any i > 0. On the other hand, Tanaka prolongation is non-trivial even for dim V = 2. 
For example, if W consists of all diagonal matrices in a certain symplectic bases of V, then Tanaka 
prolongation of W becomes zero on the third step. 

Corollary 1. If W is a subalgebra in csp(y) and dim V > 4 then the sum Mr] + V + X^j>o W^'^"^' 



has a natural structure of a graded Lie algebra, where deg r] 
for any i >0. 



-2, degy = -1, and deg PF(*™) 



We can considered the graded analogs Sgr and 5gr of Spencer operators Sp and Sp. Namely, let 
5gr be the Spencer operator of a pair (gr V, s) and let Sgr be the modified Spencer operator of the 
quintuple (gr V, givi,gicv2, tt),s), where, as before, s is the symbol of our bundle P, i.e. gr Wp = 5 
for any p £ P. 

In general, operators Sp and Sgr or Sp and 5gr are different and even operate on different spaces. 
However, they are closely related so that it is possible to carry prolongation procedure for the 
considered frame bundles on corank 1 filtered distribution in a similar way as for G-structures. 

For any two filtered vector spaces V, W the spaces V*, IIom(y, W), S^V, A^V are also naturally 
endowed with a filtration. In all these cases the associated graded vector spaces are naturally 
isomorphic to (grF)*, IIom(gr F, gr VF), S'^{gTV) and A^{grV). Moreover, any subspace U <ZV 
also inherits filtration together with a natural embedding of associated graded vector space gr U 
into gr V . In the following we shall freely use these identifications. 
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Directly from definitions one can show that the Spencer operator Sp preserves the filtration. 
The same is true for the modified Spencer operator. Indeed, for this we actually have to show 
that if vi G y(Ji), V2 G V^^'\ and the map ip G (Hom(l/, Wp)Y'\ then 

(4.19) ^p{vi,v2)Sp{^){n,v2) e yO-i+J-2+0. 

For this assume that vi G V^^^' and V2 G V^^^K Then from the fact that Sp preserves filtration 
it follows that ojp{vi, V2) Sp{(p){vi, V2) G l/(-?i+J2+*). So, if ji + J2 > ji + J2, we are done. On the 
other hand, by definition of the form Wp^gr it follows that ji + J2 = 0. So, if ji + J2 < ji + J2-, 
then ji + J2 < 0, but then by condition (2) on filtration (??) one has u)p{vi,V2) = 0. Hence (4.19) 
holds also in the case ji + J2 < ji + 32 ■ 

Besides, it is easy to show that both Sgr and Sgr are the morphisms of degree of graded 
spaces. 

Lemma 8. The operators Sgr and Sgr coincides with the graded operators gr Sp and gr Sp from 
grHom(y, Wp) to grHom(A^y, F), associated with the operators Sp and Sp under natural identi- 
fication of gT:i{oTa{V,Wp) with Hom.{gi V, 5) and giiioTa{A'^V,V) mt/i Hom(A^gr y, gr y). 

Proof. For the classical Spencer operator the statement of the lemma follows directly from def- 
initions. Let us check it for the modified Spencer operator. For this we have to check that if 
Sp : Hom(y, Wp) ^ Hom(y A V, V) is defined by 



Sp{ip){vi,V2) 
^p{vi,V2) 

then 



Ep{ip){vi,V2) =UJpivi,V2) 

(4.20) giEp{ip){xi,X2) = tr(xi,X2) 



SgT{i^){gTVl,gTV2) 



tt)(grui,grT;2) 

Take, as before, vi G F^-'i^ V2 G V^^'^^ and assume that vi G F^^^^ and V2 G V'-^'^\ Then Ji +j2 = 
and it is not difficult to show that 

grHp('(/')(grvi,grv2) = 0, if ji + J2 > 0, 

- r i\r \ >^r ^Sgr{ip){gTVi,gT:v2) -r • , • ^ n 

gr^p(V')(grwi,grw2) = rD(grwi,grv2)^— 7 — z ^r — , if Ji + J2 < 0. 

tt)(grui,grz;2) 

Taking into account the definition of the graded skew-symmetric form ro, we get that the last two 



relations are equivalent to (4.20). D 



In the following we shall also need the normalization conditions for the prolongation procedure. 
These conditions are formally defined as any graded subspace grA^ C IIom(A^gr 1/, gr y) such 
that: _ 

IIom(A^ gr V, gr V) = ini Sgr gr N. 

Now let us prove the following general lemma: 

Lemma 9. Let T : A ^ B be a mapping of arbitrary filtered vector spaces A,B preserving the 
filtration. Let gr T : gr A ^ gr i? be the associated mapping of the corresponding graded vector 
spaces. Then we have: 

(1) gr(kerT) Cker(grT); 

(2) if C is any subspace in B such that 

(4.21) grCeimgrX = grB, 

then C + \ra.T = B; 
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(3) under the assumptions of the previous items, the space grT^^{C) does not depend on C 
and coincides with ker(gr T) . 
Proof. 

1) Suppose that a E A^^) and T(a) = 0. Then grT(a + A^^-^'^) = T(a) + b(*---i) = and 
a + A^^~^> G gr A hes in the kernel of gr T. 

2) Let h be any element in B^^>. Then by assumption the element h + B^^^"^' £ gr B uniquely 
decomposes as {c + C^^~^^) + {T{a + A^''~^^)) for some elements c + C^'^"^) G gr C and a + A^'^"^) S 
gi A. Hence, we see that {b — c — T(a)) lies in B^^~^'. Proceeding by induction we get that 
6 = c' + T(a') for some elements c' £ C and a' £ A. 

3) Let a £ T^^{C) n A^''\ Then gr T(a + A'^''-^^) lies in gr C and, hence, is equal to 0. Thus, 
we have grT~^(C) C ker(grT). 

To prove the opposite inclusion ker(grT) C grT^^(C) we actually have to show that for 
any a £ A^''\ satisfying T(a) £ B^''~^\ there exist a' £ A^''^ such that a — a' £ ^(^~^) and 
T(a') £ C. For this let Tfc_i be the restriction of T to A^'^~'^\ Then from (|4.21[) it follows that 



grC^ 1) iixigr T^ = B^ ^^ Hence, by the previous item of the lemma we have 

C('=-i)+imTfc_i = B^^-^\ 

From this and the assumption that T(a) £ B^''^^' it follows that there exist Cfc_i £ C^^~'^' 
and fflfe-i £ A^''^^' such that T(a) = c^-i + T(afe_i). Therefore, as required a' one can take 
a' = a — ttk-i- Indeed, a' — a = ak-i £ A^^'^^l and T(a') = T(a — a^-i) = Ck-i £ C. This 
completes the proof of the third item of the lemma. D 

As a direct consequence of the two previous lemmas we get 
Lemma 10. Let 

Sp : Hom(y, Wp) -^ Hom(AV, V), 

Sgr : Hom(gr V, s) -^ Hom(A^ gr V, gr V) 

be the modified Spencer operators associated with the quintuples {V,vi,V2,uJp,Wp) and 
(gr V, gr vi ,grv2,K), s) respectively. 

(1) The subspace grkerSp C Hom(gry, s) associated with the subspace ker S'p C Hom(y, VFp) 
lies in ker Sgr. In other words, gr Wj^ is contained in s^^™). 

(2) Let N C Hom(A^y, 1^) be any subspace such that the associated graded space gr N C 
Hom(A^ gr V, gr V) is complimentary to im Sgr. Then A^ + im S = Hom(A^y, V) . 

(3) Let N be as in the previous item, and let 

^i'r^ = {'A G Hom(l/, Wp) I Spiel)) £ N}. 

dm) 

Then the associated graded space gr Wj^ j^ does not depend on N and coincides with 
s(im) =ker5g^. 

Note that in general ker S'p = Wp ™ has smaller dimension than kerS^^ = s'^™^ But we shall 
need only the fact that ker Sgr = implies ker Sp = 0. Besides, although the space g^W^^ 



depends in general on a choice of a pair of vectors {vi, V2) from V, satisfying (4.4), from item 3 of 
the previous lemma it foil 
of the choice of this pair. 



the previous lemma it follows that gr W„ ^ is independent not only of the subspace N but also 
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Now everything is ready to describe the prolongation procedure for the VF-structure P of frames 
with constant graded skew-symmetric form on 1). Using filtrations on V and W, define a filtration 
on the space V (BW as follows: First consider the following filtration: 

v®w = y(^) ®wd v^^'^^ ®wd ...d f(--^-i) ®wd---d v^-^'^ ew = w 

Second, take the filtration on W and make a shift of the indices (the weights) of their subspaces 
such that the index of W itself will be equal — /i. The final filtration on 1/ © VF is obtained by 
pasting together these two filtration. 



Fix a pair of vectors (1^1,1^2) from V, satisfying (4.4). We call this pair the initial pair for 
prolongation. Fix an arbitrary subspace A^ C Hom(7\ F, V) such that the corresponding sub- 
space griV C Hom(A^ gr y, gr y) is complimentary to im Sgr, and, thus, satisfies the conditions 



of Lemma 10 The first prolongation of P (subordinated to the subspace N and the initial pair 
(^1,^2)/) is a subbundle P^^' of Q consisting of all subspaces Hp complementary to Wp in 'S^^\p) 
such that C{Hp) G N. The bundle P^^' can be naturally identified with a subbundle of the 
frame bundle Fy^wi^ )■ For this let {il)p}p^p be a smooth family {■il}p}p^p of isomorphisms 
Tpp : W ^ Wp, as in Definition kil Then for any point p^^' = (p, Hp) G P^^' one can define a 
linear map L^a) : V ®W ^ TpP such that {L^(i))~^\hj, = p~^ o dpTiUp and Lp{i)\w = ipp, where 
in the first relation p is identified with an isomorphism from V to 2)(7r(p)) as in the beginning of 
the section. The skew-symmetric form o\iV(BW corresponding to a point p^^> is such that its 
restriction to V coincides with the form u)p and the subspace W belongs to its kernel. It implies 
that the bundle P^^' has a constant graded skew-symmetric form as well and that the initial pair 



of vectors (^1,^2) satisfies the relation analogous to (4.4) for this graded skew-symmetric form 



Furthermore, the tangent space to the fiber of P^^> can be identified with the subspace W!" L as 



in item (3) of Lemma 10 In particular, from the same item it follows that the first prolongation 
P^"^' has constant symbol. 

How to identify the tangent spaces to the fibers of P^^' at different points? Namely, we have 
to identify subspaces W^ ^ and W^ ^ for different pi,P2 £ P- For this let A^' be any subspace of 

Hom(y, W^) such that grA^' is complimentary to 5*-^'. Then, since grWj^ is equal to s'^-* for all 

p G P, we see that A^' is complimentary to W^ j^. Thus, by fixing an appropriate subspace A^', we 

can identify all spaces W^ ^ with W^ = IIom(y, W)/N'. The space W'^ has the natural filtration, 

induced by the filtration on IIom(y, W). The identifications between PVj j^ and W'^ preserves the 
filtrations on this spaces. 

As a conclusion, starting with 1^-structure P and fixing two spaces A^ and A^' as above, one 
can define the first prolongation P^^' of P such that it is endowed with M^^-structure for an 
appropriate space W^ and it has constant graded skew-symmetric form. In the same way, fixing 
appropriate spaces A'^i and A'^( one can define the second prolongation P^'^' = (p(^))(^) and so 
on. The sequence (A^, A^', Ni,N[, . . .) is called a sequence of defining spaces for the prolongation 
procedure. 

Assume now that for some /c G N the kth modified prolongation s^^"^' is equal to zero. It implies 
that choosing a sequence of defining subspaces we will get a canonical Ehresmann connection 
on the A:th-prolongation P^'^), subordinated to the chosen sequence of defining subspaces, and, 
consequently, the canonical frame on the corresponding corank 1 distribution T)^ ' of P^ '. This 
frame can be extended to the canonical frame on P^^' by taking the Lie brackets of the vector 
fields in the frame, corresponding to the initial pair (ui,U2). More precisely, a frame on 1)^ ' 
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is a family of isomorphisms p^''^ : V (BW (B W^ ... © W''~^ ^^ S)*^'^)(p('^)). The additional vector 
field, which extends this frame to the frame on P^ ' , can be taken as [p^ '{vi),p^ '{V2)], i.e. 
one can extend the map p^ ' from the vector space F © VF © W^ ... © W to the vector space 
y©VF©l^-^ . . .®W''~'^BRh' such that p^^\u) = [p^^\vi),p^^\v2)]- Our constructions immediately 
imply the following 

Theorem 2. Assume that P is a W -structure with a constant graded skew- symmetric form and 
a constant symbol s. // the modified kth prolongation s^^"^> of 5 vanishes for some k ^ N, then 
with each such P, an initial pair of vectors for prolongation, and a sequence of defining spaces 
one can associate a canonical frame on a kth prolongation P^ > of P. Two such W -structures are 
locally equivalent if and only if their canonical frames corresponding to the same initial pair of 
vectors for prolongation and the same sequence of defining spaces are locally equivalent. 

The last theorem shows that in order to prove the existence of canonical frame on certain 
prolongation of the bundle P it is sufficient to analyze the modified prolongations of its symbol 
only. 

5. Symbols and prolongations of VF-structures for rank 3 distributions 

Let, as above, ^ be a vector space endowed with a skew-symmetric bilinear form a. Note that 
we do not require it to be non-degenerate, although most of the computations in this section 
will be done for non-degenerate form. Let, as above, W be any subspace in 0((T^). Again, in all 
computations below this will be actually a subalgebra in csp(y). 



Let us recall that according to (4.11 ) the modified prolongation of the subspace VF is a subspace 
^r{lm) jj^ Hom(y, 3) consisting of all maps (j): V ^ W, for which we can find a vector v (^ V such 
that the following identity is satisfied: 

(5.1) (t>{vi)v2- 4>{v2)vi = a{vi,V2)v, for all f 1 , f 2 S y. 

Note that if such vector v £ V exists for a given map (j), then it is unique. So, we can always 
identify VF(^"^) with a subspace in Hom(VF, V) x V complimentary to the second summand and 



consisting of all pairs (</>, u) satisfying (5.1) 



It is clear that the standard first prolongation W^^' of W, defined as a set of all maps (j)' : W ^ V 
satisfying the equation: 

4>'{vi)v2 - (t>'{v2)vi = O,for all fi,f2 € V, 

is a subspace in the modified prolongation, as it corresponds to all pairs {(j), v) from the modified 
prolongation with v = 0. 

5.1. The symbol for non-rectangular diagrams. Let us describe the symbol 5k,i for the 
W^-structure Pk^i with I > 0. Let r = 2k + I — 1 and let F be a vector space with a basis 
{ei,...,er-,/i,...,/r}. 

Let us define linear maps X, H, Y, Zi, Z2 G End(y) as follows: 

Xci = Cj+i, Xfi = fi+i, (i = 1, . . . ,r - 1), Xcr = Xfr = 0; 
He, = {r + 1- 2i)ei, Hfi = {r + 1- 2i)fi, (i = 1, . . . , r); 

Ye, = {i- l)(r + 1 - i)ei^i,Yf, = (i - l)(r + 1 - i)/i_i, (i = 2, . . . ,r), Yei = Yf, = 0; 
Zid = Cj; Zifi = -fi, (i = 1, . . . , r); 
Z2ei = Cj; Z2fi = fi,{i = 1,.. . ,r). 
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It is easy to check that the elements X, H, Y form a basis of a three-dimensional subalgebra in 
g[(y) isomorphic to sl(2,]R). Both elements Zi and Z2 commute with this subalgebra. Denote 
by the 5-dimensional subalgebra in qI{V) generated by these elements. Note also that the 
decomposition V = Ve ® Vf is stable with respect to the action of a. Denote also by ao the 
subalgebra in a of codimension 1 generated by elements H, Y, Zi,Z2. 

According to Definition |2] define also a symplectic form o" on T4 © V/ by the formula 

a{ei,ej) = a{fi, fj) = 0; 

a{ei,fr+i-i) = (-1)*; 

<^{ehfj) =0, i + j / r + 1. 

We can see immediately that all five endomorphisms X, H, Y, Z\ , Z2 preserve the symplectic form 
up to a scalar multiplier. 

Consider now the action of 5l(2,M) (generated by X,H,Y) on the space of all linear maps 
Hom(Vj,V"e) C Qi{V). The symplectic form a gives us an isomorphism of 5l(2, i2)-modules Vf 
and Ve- Hence, the 5[(2, M)-module Hom(Vy, Ve) is naturally isomorphic to Vr i^Ve = Ve^Ve and 
decomposes into irreducible s[(2,M)-submodules Il2r-2, ^2r-'i, ■ ■ ■ , ^2, Hq of dimensions 2r — 1, 
2r — 3, . . . , 3, 1 respectively. 

Under identification of Vf with V^, the subspace of all elements from Hom(y^, V^) that preserve 

the symplectic form is naturally isomorphic to S'^{Ve) and decomposes as s[(2, M)-module into the 
sum of submodules Il2r-2, n2r-6i • • • ) n2 (for even r) or Ho (for odd r). 

Define the subspace p C S'^{Ve) C B.om{Vf,Ve) C End(y) as the sum of irreducible 5[(2,]R)- 
submodules U2r-4k+2 = 112;, n2/-4, • • • , 112 (or IIo). 

Theorem 3. The symbol s^^i, corresponding to the non-rectangular diagram of type {k,l), is 
equivalent to the subalgebra o + p C End(y), which in turn is equal to the algebra of infinitesimal 
symmetries of the corresponding flat curve dk,i- 

Proof. To prove the theorem, we can consider any curve with the required diagram. We shall 
consider the flat curve ^k,i as a simplest possible case and prove that in this case the Vl^-structure 
is in fact a standard G-structure with a Lie algebra g = a + p. 

Let us compute the symmetry group Sym.{^k,l) of dk,l consisting of all linear transformations 
of V that preserve the form a up to the constant and map the curve ^^^i to itself. It is easy to see 
that this is a well-defined closed Lie subgroup in GL{V). Denote by SyniQ{^k,i) the subgroup of 



Syni{^k,i) stabilizing the flag (1.2) and by syin{^k,i) and sym.Q{^k,i) the corresponding subalgebras 



ing[(F). Letgobe the subalgebra in g [( 1/) consisting of all linear maps that stabilize the flag (1.2). 
Note, that, in particular, Oq -|- p C go. It is easy to see that syuiQ{^k,i) is a Lie algebra of the 
subgroup of Sym(5fc,i) that stabilizes the point ^k,iiO). As ^k,i is one-dimensional, syuiQ{^k,i) has 
codimension 1 in sym.(^k,i), and, hence, sym(5'fe,/) = sym.Q{^k,i) -|-MX. 

According to [2^, the algebra symQ(5fc^i) can be defined as a largest subalgebra I) in go that 
satisfies the condition [X, f)] C f) -|- MX. We shall use this characterization to prove that in fact 
symo(5^fc,z) = tto + p. As [X, ao] C a = Oo -|- MX and [X, p] C p, we see that the subalgebra ao -|- p 
does satisfy the above condition, and, thus, lies in symo(5^fc,/)- 

On the other hand, the dimension of symQ(5^fc^;) can not exceed the dimension of the space of 
all (fc, /)-quasisymplectic frames at the point ^k,i{0). As follows from Proposition [I] the space 

of all (A;, /)-quasisymplectic frames has dimension 1 -|- X]r=o(^' — 4r -|- 1). Taking into account 
the two-dimensional space of projective reparametrizations leaving a point dk,i(S^) fixed, and a 
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one-parameter group of all scalings of the symplectic form cr, we see that the space of all {k,l)- 

quasisymplectic frames has dimension 4 + YllLoC^^ — 4r + 1). But we have dimao = 4 and 

dimp = X]r=o(^^ — 4r + 1). This proves that symo(5^A;,0 = do + P and, thus, syin.{^k,i) = a + p. 

Hence, the VF-structure of all {k, /)-quasisymplectic frames associated with a flat curve is a 
standard G-structure with G = SymQ(5'fc,/)- In particular, any quasi-symplectic moving frame is 
in fact symplectic in case of the flat curve. 

D 

Let us prove now that this symbol is always of finite type and compute its prolongation explicitly 
in case k = 2 (and / > 0). 

Lemma 11. The modified prolongation (sfc,;)'^"*' coincides with the standard prolongation p'^-* 
of the subspace p. 

Proof. Let {4>,v) be any element in {Sk,i)^^"^'. Let us note that the space a + p is in fact a 
subalgebra in 0((1^) preserving the subspace Ve <ZV . The restriction of this subalgebra to Ve is 
4-dimensional and is generated by the elements Xy^, Hy^, Yy^ and {Z\)y^. In particular, it is 
equal to the image of the irreducible embedding of g[(2,M) into 0[(T4). 

Let ((/), v) G (sfc,0 • Lst us prove that t; = and 4> takes values in p. Consider the equa- 



tion (5.1) in the following cases. 

1°. v\^V2 G Ve- As the restriction of the symplectic form to Ve vanishes, we get <^{v\)v2 = 

(/>(i;2)wi, which is exactly the equation for the standard prolongation of the restriction of Oq + p 

to Ve- According to the result of Kobayashi-Nagano [7], the first prolongation of the irreducible 

embedding of g[(2,]R) is non-zero only if the dimension of the representation space does not 

exceed 3. In our case the lowest possible dimension of Ve is achieved when A; = 2,/ = 1 and is 

equal to 4. Thus, we see that 0(fi)w2 = for all fi,f2 G Ve- In particular, this implies that 0(14) 

lies in M(Zi - Za) -h p. 

2°. v\^V2 G Vy. As Vj is also an isotropic subspace, we also get <\>{v\)v2 = 4>{v'2)v\. Considering 

this equation modulo T4, we again get that </>(vi)f2 = mod Ve- This implies that (/'(V/-) C 

M(Zi + Z2) + p. 

Cases 1 and 2 above imply that ^ can be decomposed as follows: 

(5.2) <^{Ve + «/) = ^{Ve + V^) + a{ye){Z^ - Z2)/2 + P{vf){Zi + Z2)/2, Vt;e G Ve,Vf G Vf, 

where (/>' takes values in p, a G T^* and (3 £ V^ . 
3°. vi = Ve € Ve, V2 = Vf £ Vf . Then we get: 

(p{Ve)vf - (t){vf)Ve = a{Ve,Vf)v. 

Considering this equation modulo Ve and taking into account that p vanishes on Ve and sends Vf 
to Ve, we get: 

a{ve)vf = a{ve, Vf)v mod Ve, for any Ve G Ve, Vf G Vf. 
As the dimensions of Ve and Vf are at least 4, for any Ve we can find a non-zero vector Vf G Vf 
such that a{ve,Vf) = 0. Hence, we see that a{ve) = 0. In particular, we also see that v G I4. 



Let us now fix an arbitrary Ve G Ve- From (5.2) we have 4'{ve) = (p'^Ve)- Let us prove that 
4>'{ve) = 0. Indeed, we have 

4)'{ve)vf = a{ve,Vf)v + (3{vf)ve, for any Vf G Vf. 

The element (p'i^Ve) lies in p, while the right hand side defines a certain linear map from Vf to V^ 



e. 



which has rank < 2. However, as we shall see later (Corollary to Lemma 13), the space p does 



not contain any non-zero elements of rank 2 or less. Thus, we get 0'(fe) = and v is proportional 
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to Ve- As Ve caii be arbitrary and the dimension of the subspace Ve is at least 4, this imphes that 
t; = and /? = 0. 

Hence, (j) takes values in p and the modified prolongation (Sfc^;)*-^™' coincides with (sfc^;)^^^. D 

Lemma 12. Let a he any (possibly degenerate) skew- symmetric form on V . Suppose V is 
decomposed as E ® F , where both E and F are isotropic and F has a trivial intersection with 
kernel of a. Let W he a subspace in Hom(F, £') C End(y) not containing elements of rank 1. 
Then we have: 

(1) the modified prolongation W^^"^' coincides with the standard prolongation W^^> ; 

(2) the space W = W^^"^' = W^'^' , considered as a subspace mEnd(y), V' = W xV, satisfies 
the conditions of the lemma for the decomposition V = E' ® F' , where E' = W x E, 
F' = F. 



Proof Let {(f), v) G W^^"^\ Consider (5.1) for v^ £ E, Vf £ F. As 4>{vf)ve = 0, we get <J3{ve)vf 



a{ve,Vf)v. So, the element 4>{ve) is a map of rank < 1. Hence, by assumption of the lemma, 
we get (p^Ve) = for all Ve G Ve- Since F has a trivial intersection with kero", for any non-zero 
Vf £ F there exists such Ve G E that a{ve,Vf) ^ 0. Hence, we also get v = 0. This proves that 

Let us prove the second part of the lemma. We have already proved above that 4>{ve) = for 
any Ve G E. Hence, ly^^*") lies in ilom.{F' , E') C End(y). It is sufficient to show that W does 
not have any elements of rank 1. Suppose, there is such an element. Then it can be represented 



as Vf 1-^ a{vf)wQ for some non-zero a G F* , wq G W. Again, considering equation (5.1) for two 
vectors fi, f2 G F, we get: 

a{vi)wo{v2) = a{v2)wo{vi), for all fi,f2 G F. 

We can always choose such vq G F that a{vo) ^ 0. Then we get 'Wo{v) = a{v)wo{vo) / a{vo) for 
any v £ F. Hence, vuo has rank 1 as well, and this contradicts the assumption of the lemma. D 

Corollary 2. The modified prolongation (syt,/ )'-*'"•* coincides with the standard prolongation p'*-* 
of the subspace p for any i > 1. 

Proof. Indeed, it is easy to see that subspace p C Hom(F, E) C End(y) satisfies the condition of 



the lemma. Hence, p^*™-) = p(*) for all i > 0. And according to Lemma 11 we have {sk^i)^^"^' 



p(im) ^ p(i)_ Hence, (sfc,z)(*"^) = p(*"*) = p(^) for any i > 1. D 

To prove that the standard A^-th prolongation p^^' vanishes for sufficiently large N, we shall 
accumulate the language of symplectic geometry and Poisson bracket. Let us introduce the space 
M?^ with coordinates xi, . . . , Xr,pi, ■ ■ ■ ,Pr and the symplectic from: 

dxi A dpr — dx2 A dpr-i -|- • • • -|- {—lydxr A dpi. 

Note that the space of all polynomials M[xj, pj] with the Poisson bracket defined by this symplectic 
form is a Lie algebra with one-dimensional center generated by 1. 

Let us identify Ve © Vf with subspace in M[xi,pj] consisting of all polynomials of degree 1 
identifying basis vectors e^ with polynomials Xi and basis vectors fi with pi, i = 1, . . . ,r. It is 
well-known that sp(I4 © Vy) can be identified then with the space of all quadratic polynomials in 
M[3;j,pj], and A;-th prolongation of sp(ye © Vf) with the space of all polynomials of degree k + 2. 

Since the subspace p lies in S'^{Ve) = Vr Ve C 5p(ye © Vf), we see that we can interpret it 
as a certain subspace of degree 2 polynomials in xi, . . . ,Xr. Let us define this subspace in a more 
geometric way using the language of algebraic geometry. Let ¥Vf be the projectivization of the 
subspace Vf and let C be the orbit of exp(a) through the vector /i. As ao and, hence exp(ao). 
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preserves M/i , we see that this orbit is l-dimensional. It is evident that C is a closure of the orbit 
of exp(tX) and is a rational normal curve in IPV/. 

Let P''~i be the projective space with homogeneous coordinates [xi : X2 : ■ ■ ■ : Xr]. Denote by 
C the normal rational curve in f'^~^ given as an image of the Veronese embedding 

(5.3) pi^P'-i, [s : t] ^ [s''-^ : s-'-H : . . . : f-^]. 

By fixing a rational normal curve C in p^'~i we also fix the structure of S'L(2,M)-module on W. 

Denote by T^C the n-th tangential developable variety of C. Here we assume that T^C = C. 
If V is any algebraic variety in F^~^, we denote, as usual, by /(V) the ideal of homogeneous 
polynomials in xi,...,Xr vanishing on V. We shall also denote by /n(V) the subspace of all 
polynomials of degree n in /(V). Denote also by 5„V the n-th secant variety of V, which is 
defined as an algebraic closure of the union of (n — l)-planes in P^~i passing through n points 
from V. By definition we set 5i(V) = V. 

Let us recall a standard result from algebraic geometry: 



Lemma 13 ([5 ). Let 



S {W'*) — 2_^^2r-4:i-2 
i>0 



be the decomposition of the SL(2,M.) -module S'^{W'*) into the sum of the irreducible submodules, 
where Urn is a, unique submodule of dimension m + 1. 

Then the space l2{T^C) of all degree 2 polynomials vanishing on T^C is equal to X]j>s ^2r-4i-2- 

Corollary 3. The space l2{C) does not contain non-zero elements of rank < 2. 

Proof. According to the lemma, any element from I2{C) should vanish on C. Suppose that 
I{C) contains any element F of rank < 2. Then it lies in a linear combination of polynomials 
G^, GH, H^ for certain homogeneous degree 1 polynomials G, H. We can always extend our base 
field to C and decompose F into the product of two linear polynomials G' and H' . As F vanishes 
on the rational curve, we see that either G' or H' should also vanish on G. However, this is 
impossible as C does no lie in any proper linear subspace in F^~^. D 

Using Lemma [13] above we get 

Theorem 4. The subspace p C S'^{Ve) can be identified with the space of all quadratic polynomials 
in xi, . . . ,Xr that vanish at {k — 2)-th tangent developable variety of G . 

The n-th prolongation of p in contained in /n+2(V), where V = Sn+i{T^~'^G) is the (n + l)-th 
secant variety of {k — 2)-th tangential variety to the rational normal curve G . 



Proof. The first part of the theorem immediately follows from definition of p and Lemma 13 

To prove the second part, let us consider a more general case. Let V be an arbitrary algebraic 
variety in p*""! and let /2(V) be the set of all quadratic polynomials in xi, . . . , Xr vanishing at V. 
If we consider /2(V) as a subspace in S'^{Ve) C Hom(Vy, Ve) C 5^^)) then its n-th prolongation 
can be identified with polynomials F{xi, . . . , Xr) of degree n + 2 such that af „ q^ ^ -^2(V) for 

all multi-indices a = (qi, . . . , Ur) with \a\ = n. It is clear that any such polynomial and all its 
partial derivatives of degree < n lie in /(V). 

Let us prove that any such polynomial F vanishes identically at 5„+i(V). It is sufficient to 
prove that it vanishes at any secant n- plane of V. Indeed, let poi • • • iPn G V be the set of n -|- 1 
points and let 
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be the embedding of the corresponding secant n-plane. Then F oW is a polynomial of degree 
n + 2 on P" that vanishes at basis points qi £ P", i = 0, . . . , n, and, in addition, all its derivatives 
of degree < n also satisfy this property. This immediately implies that F o W = 0. Hence, F 
vanishes identically at 5„+i(V). D 

Corollary 4. The subspace p, and, hence, the symbol 5k ^i is of finite type. 

Proof. Since the rational normal curve C is non-degenerate, its r-th secant variety coincides with 
P''"^ Hence, Sn+i{T''~^C) = P*""^ for any n > r - 1. Then the ideal /(V) is trivial, and 
/n+2(V) = {0}. D 

Let us consider the case A; = 2 in more detail. We have a well-known description of n-secant 



varieties of the rational normal curve (5.3): 

Lemma 14 ([6 ). Let V = Sn{C) be the n-secant variety of C, where n > 0. Then the ideal /(V) 
is generated (as an ideal) by /„+2(V). The space /n+2(V), in its turn, is generated (as a linear 
space) by all rank n + 2 minors of the matrix: 

( X\ X2 X3 ... Xr-a \ 

X2 X3 X4 . . . Xr-a+l 

\Xa+l Xa+2 Xa+2 ■■ ■ Xr ) 

where a is an arbitrary integer between n and r/2. 

In particular, we see that in case k = 2 the space p*-"-', n > coincides with the ideal In+2{SnC) 



and is described explicitly by Lemma 14 



5.2. The symbol in case of rectangular diagrams. In this subsection we describe the symbol 
5kfl for M/^-structure Pkfi-, constructed in case of rectangular diagrams. Let r = 2A; — 1. We assume 
that A; > 3, so that r > 5. The case k = 2 corresponds to non-degenerate (3,6) distributions, and 
has been studied by Bryant |I] . 

Let U be an irreducible s[(2,M)-module of dimension r. Define a Lie algebra a as a direct 
product s[(2,M) x gl(2,R) and define a natural action of a on the tensor product V = U M?. 
We shall identify o with the subalgebra in 0^(1^) defined by the action of o on V. 

There is a unique (up to a constant) (5((2, M) xs[(2, ]R))-invariant symplectic form a on V, which 
can be defined as a product of a (unique up to a constant) s[(2,M)-invariant non-degenerate 
symmetric form on U and the standard skew-symmetric form on M? preserved by the second 
s[(2,M). 

Theorem 5. The symbol 5k fi for rectangular diagrams is equivalent to the subalgebra a C 0((^), 
which in turn is equal to the algebra of infinitesimal symmetries of the flat curve ^k,o- 
The first modified prolongation (s^^q) i^ trivial for k > 2. 

Proof. The first part of the theorem can be proved in the same way as Theorem [3| 

Let us prove the second part. Denote by {ei, 62, • . . ,6^} the standard basis of the 5[(2,M)- 
module U and decompose V as (B^^iVi, where Vi = Rei'^M.'^. Then we have a.Vi C Vi-i + Vi + Vi+i 
for z = 2, 3, r — 1 and a.Fi C 14 -|- V2, a.Vr C Vr-i + Vr. Note also that (cj, Cj) = for any i+j / 6. 
In particular, we get (7{Vi, Vj) = for any i + j ^ 6. 



Let ((/), v) be the element of the modified prolongation of 0. Consider equation (5.1 ) for vi € Vi 
and V2 G K--1- As cr{vi,V2) = 0, we get (j){vi)v2 = 4>{v2)vi. Since 4'{vi)v2 lies in a.Vr-i C 
Vr-2 + Vr-i + Vr and (j){v2)vi lies in Vi + V2, we see that both parts of this equality should 
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vanish. This is possible only if (f){vi) lies in MH + g[(2,M), and, in particular (j){Vi)Vi C Vi for all 
i = 1, . . . , r. Similarly, we can prove that 4>{Vr)Vi C Vi for i = 1, . . . ,r. 



Consider now equation (5.1) for vi G Vi and V2 £ Vr- We get v G (l){Vi) .Vr + (l>{yr) -Vi C Vi + Fj.. 
On the other hand, if we consider ^1,^2 S Vk (recall that r = 2k — 1), we see that v £ a-Vk C 
Vk-i + Vfc + Vfc+i. As A; > 3, we get v = and the modified prolongation a'^"^^ coincides with the 
standard prolongation o'^-*. But according to Kobayashi-Nagano [7], 0'^^ is trivial for r > 5. D 

Finally note that the Main Theorem, formulated in the Introduction, is obtained by combining 
Theorem [2] Lemma [7j Theorem [3j Corollary [4j and Theorem [5] 
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